| Job Description: |
We are looking for an experienced Data Engineer to join our team in Mumbai. As a Data Engineer, you will be responsible for designing, building, and maintaining efficient data pipelines that transform raw data into actionable insights. You will work closely with data scientists and analysts to ensure that data is accessible, reliable, and optimized for analysis. Your role will also involve handling large datasets, ensuring data quality, and implementing data processing frameworks.
Key Responsibilities:
Design and build scalable data pipelines for processing, transforming, and integrating large datasets.
Develop and maintain ETL processes to extract, transform, and load data from multiple sources into the data warehouse.
Collaborate with data scientists and analysts to ensure that the data is optimized for analysis and modeling.
Ensure the quality, integrity, and security of data throughout its lifecycle.
Work with cloud-based technologies for data storage and processing (AWS, Azure, GCP).
Implement data processing frameworks for efficient handling of structured and unstructured data.
Troubleshoot and resolve issues related to data pipelines and workflows.
Automate data integration processes and ensure data consistency and accuracy across systems.
Required Skills:
5+ years of experience in Data Engineering with hands-on experience in data pipeline development.
Strong expertise in ETL processes, data integration, and data warehousing.
Proficiency in SQL, Python, and other programming languages for data manipulation.
Experience with cloud technologies such as AWS, Azure, or Google Cloud.
Knowledge of big data technologies like Hadoop, Spark, or Kafka is a plus.
Strong understanding of data modeling, data quality, and data governance.
Familiarity with NoSQL databases (e.g., MongoDB, Cassandra) and relational databases.
Strong analytical and problem-solving skills with the ability to work with large, complex datasets.
|
Thursday 15 August 2019
03:00
03:00
