Data Engineer
Pune, India
Must have
-
Over 7 years of experience in designing, implementing, deploying, and supporting various data management technologies and architectures
-
Perform data loads and optimize data for extraction and reporting use
-
Assist with the discovery of data requirements to ensure proper data collection and plan/roadmap the analysis
-
Ability to create and maintain complex data pipelines that support high-volume, high-dimensionality data from varying sources using a variety of tools and ETL techniques
-
Maintain complex databases by performing appropriate database management functions (e.g., maintain space availability, rebuild indexes, file clean-up, runs utilities to check database integrity) to ensure optimum capacity and application performance
-
Experience with ETL tooling - especially Apache Airflow
-
Experience using AWS services such as S3, Redshift, Lambda, RDS
-
Experience of data migration, transformation, orchestration, loading and reporting using RDBMS (MySQL, PostgreSQL), Files and APIs
-
Produce and maintain data pipelines in support of client and internal reporting needs
-
Support the development of client-facing documentation such as a comprehensive data dictionary and data model documentation
-
Establish and maintain data models in support of operational reports, dashboards, and scorecards for internal and external clients
-
Skills in programming languages such as Python
-
Strong understanding of different data warehouse schema designs, data model design and documentation, as well as query optimization
-
Experience with relational and non-relational databases: PostgreSQL, MySQL, Redshift, Snowflake, Elastic Search, MongoDB, table design and query optimization for each specific platform
Good to have
-
Experience with Power BI or other data visualization tools preferred
-
Actively contributes within a collaborative team setup, working alongside business leaders, stakeholders, and project teams
-
Strong expectation-setting on required effort/duration to reliably deliver work to meet client deadlines