Python Data Engineer

We are seeking a highly skilled and motivated Python Data Engineer to join our dynamic team. As a Python Data Engineer, you will play a key role in designing, developing, and maintaining robust data processing pipelines to support our organization’s data-driven initiatives. Your primary responsibilities will include:

• Data Pipeline Development: Design and implement scalable and efficient data pipelines for the extraction, transformation, and loading (ETL) of large volumes of structured and unstructured data.
• Data Integration: Collaborate with cross-functional teams to integrate diverse data sources into a unified data platform. Ensure seamless data flow and accessibility across the organization.
• Data Modeling: Develop and implement data models that support business requirements and ensure data accuracy and consistency. Optimize data storage and retrieval processes for optimal performance.
• Performance Optimization: Identify and address performance bottlenecks in data processing pipelines. Optimize code and queries to enhance overall system efficiency.
• Data Quality Assurance: Implement data quality checks and validation processes to ensure the integrity and accuracy of data. Troubleshoot and resolve data quality issues in a timely manner.
• Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand their data requirements and provide support in delivering high-quality data solutions.
• Technology Stack Management: Stay abreast of emerging technologies and industry trends related to data engineering. Evaluate and recommend tools and frameworks that enhance the efficiency and scalability of data processes.
• Documentation: Maintain comprehensive documentation for all data engineering processes, ensuring knowledge transfer and ease of collaboration within the team.
• Security and Compliance: Implement and adhere to data security and compliance standards. Collaborate with the security team to ensure data privacy and protection.
• Continuous Improvement: Actively participate in code reviews, identify areas for improvement, and contribute to the continuous enhancement of data engineering best practices within the organization.

Qualifications:

• Bachelor’s or higher degree in Computer Science, Information Technology, or a related field.
• Proven experience in Python development, with a focus on data engineering.
• Strong understanding of database design, data modeling, and data warehousing concepts.
• Experience with ETL tools and frameworks.
• Proficiency in working with big data technologies (e.g., Apache Spark) is a plus.
• Solid understanding of data storage solutions (relational databases, NoSQL databases, etc.).
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration skills.