Role :
Data Engineer
Location :
Banglore
vthetecheejobs.com
Job description
- Design and develop data ingestion frameworks, real-time processing solutions, and data processing/transformation frameworks to streamline data handling.
- Deploy and support application code and analytical models to ensure smooth operation.
- Create and enhance data solutions that enable seamless data integration and flow across the entire data ecosystem.
- Provide business analysis and develop ETL code and scripts to meet technical and business requirements according to established designs.
- Develop real-time data ingestion and stream-analytic solutions using technologies like Kafka, Apache Spark (SQL, Scala, Java), Python, and Hadoop Platform.
- Prototype and evaluate solutions using various development languages/tools (Python, Spark, Hive, Presto, Java) to assess effectiveness and feasibility.
- Develop application systems that adhere to standard development methodologies for design, programming, backup, and recovery, ensuring high-performance and data integrity.
- Collaborate with other team members to provide system support.
- Operationalize open-source data-analytic tools to facilitate enterprise use.
- Implement or validate data lineage, quality checks, and data classification to ensure adherence to data governance policies.
- Understand and follow the company’s development lifecycle for solution development, deployment, and delivery.
Explore more new job openings
What you will do
- Experience in designing and developing data ingestion frameworks using open-source tools and data processing frameworks.
- A proven track record of designing and developing complex and critical data projects.
- The ability to develop, implement, and support application code and analytical models.
- A knack for creating and enhancing data solutions that enable seamless data integration and flow.
- Experience in designing and developing real-time processing solutions.
Education Requirement
Experience in the above mentioned requirements are highly preferable
Good to have skills
- Proficiency in programming languages like Python, Spark, Hive, Presto, and Java.
- Strong analytical and problem-solving skills.
- Excellent communication and collaboration skills.
- A meticulous approach to data quality and governance.
