
Data Engineer
at Cloud infrastructure solutions and support company. (SE1)
- Design, create, test, and maintain data pipeline architecture in collaboration with the Data Architect.
- Build the infrastructure required for extraction, transformation, and loading of data from a wide variety of data sources using Java, SQL, and Big Data technologies.
- Support the translation of data needs into technical system requirements. Support in building complex queries required by the product teams.
- Build data pipelines that clean, transform, and aggregate data from disparate sources
- Develop, maintain and optimize ETLs to increase data accuracy, data stability, data availability, and pipeline performance.
- Engage with Product Management and Business to deploy and monitor products/services on cloud platforms.
- Stay up-to-date with advances in data persistence and big data technologies and run pilots to design the data architecture to scale with the increased data sets of consumer experience.
- Handle data integration, consolidation, and reconciliation activities for digital consumer / medical products.
Job Qualifications:
- Bachelor’s or master's degree in Computer Science, Information management, Statistics or related field
- 5+ years of experience in the Consumer or Healthcare industry in an analytical role with a focus on building on data pipelines, querying data, analyzing, and clearly presenting analyses to members of the data science team.
- Technical expertise with data models, data mining.
- Hands-on Knowledge of programming languages in Java, Python, R, and Scala.
- Strong knowledge in Big data tools like the snowflake, AWS Redshift, Hadoop, map-reduce, etc.
- Having knowledge in tools like AWS Glue, S3, AWS EMR, Streaming data pipelines, Kafka/Kinesis is desirable.
- Hands-on knowledge in SQL and No-SQL database design.
- Having knowledge in CI/CD for the building and hosting of the solutions.
- Having AWS certification is an added advantage.
- Having Strong knowledge in visualization tools like Tableau, QlikView is an added advantage
- A team player capable of working and integrating across cross-functional teams for implementing project requirements. Experience in technical requirements gathering and documentation.
- Ability to work effectively and independently in a fast-paced agile environment with tight deadlines
- A flexible, pragmatic, and collaborative team player with the innate ability to engage with data architects, analysts, and scientists

Similar jobs

Job Details
- Job Title: Lead I - Data Engineering (Python, AWS Glue, Pyspark, Terraform)
- Industry: Global digital transformation solutions provider
- Domain - Information technology (IT)
- Experience Required: 5-7 years
- Employment Type: Full Time
- Job Location: Hyderabad
- CTC Range: Best in Industry
Job Description
Data Engineer with AWS, Python, Glue, Terraform, Step function and Spark
Skills: Python, AWS Glue, Pyspark, Terraform - All are mandatory
******
Notice period - 0 to 15 days only
Job stability is mandatory
Location: Hyderabad
Profile: AWS Data Engineer
Mandate skills :AWS + Databricks + Pyspark + SQL role
Location: Bangalore/Pune/Hyderabad/Chennai/Gurgaon:
Notice Period: Immediate
Key Requirements :
- Design, build, and maintain scalable data pipelines to collect, process, and store from multiple datasets.
- Optimize data storage solutions for better performance, scalability, and cost-efficiency.
- Develop and manage ETL/ELT processes to transform data as per schema definitions, apply slicing and dicing, and make it available for downstream jobs and other teams.
- Collaborate closely with cross-functional teams to understand system and product functionalities, pace up feature development, and capture evolving data requirements.
- Engage with stakeholders to gather requirements and create curated datasets for downstream consumption and end-user reporting.
- Automate deployment and CI/CD processes using GitHub workflows, identifying areas to reduce manual, repetitive work.
- Ensure compliance with data governance policies, privacy regulations, and security protocols.
- Utilize cloud platforms like AWS and work on Databricks for data processing with S3 Storage.
- Work with distributed systems and big data technologies such as Spark, SQL, and Delta Lake.
- Integrate with SFTP to push data securely from Databricks to remote locations.
- Analyze and interpret spark query execution plans to fine-tune queries for faster and more efficient processing.
- Strong problem-solving and troubleshooting skills in large-scale distributed systems.
● Develop, test, implement and maintain application software
● Take part in software and architectural development activities
● Debug application issues and helping support respond to client queries
● Participate in application development meetings
● Provide accurate estimates, clearly communicate status of tasks and
identification of risks
● Commitment to accomplishing the task at hand and identify the fastest and
most reliable way to solve a problem
● Performance tuning of application code at different service levels
● Interact with customers of the application and help address issues reported
ESSENTIAL SKILLS / EXPERIENCE REQUIRED:
● Bachelor's degree in Computer Science or equivalent
● 1- 6 years of experience with Java and J2EE/Java EE
● Experience with Spring and Hibernate/ ORM
● understanding of relational database and normal forms
● understanding of SQL concepts and ability to write optimised and high
performing queries
● Strong understanding of Java concurrency, concurrency patterns, experience
building thread safe code
● Experience building RESTful web services
● Experience with web application servers like JBoss
● Strong written and verbal communication skills
● Strong interpersonal skills and time management skills
● Strong problem solving and analytical skills
● Experience using task tracking version control systems e.g. Jira and Git
● Understanding of testNg/JUnit
● Experience with NoSQL Database is a plus
● Experience with CI/CD pipeline like Jenkins, containerisation tools like
docker/kubernetes is a plus
- Job Title:- Sales Manager
- Exp:- 1yr to 3yrs
- Location:- Bopal, A’bad
- Of Days Working:- 6 Days
- Timing:- 9.30am to 6.30pm
- Qualification:- Graduate, Preferred if an engineer or having an experience in the similar industry.
Job responsibility:-
- Conducting Market research by identifying selling possibilities and evaluating customer needs.
- Actively seeking out new sales opportunities through cold calling , networking in sites and other platforms like India Mart and trade India.
- Setting up a meeting with potential clients and understanding their need or concern.
Required Skills:
• 4+years of software development experience
• Good grasp on programming fundamentals including OOP, Design Patterns, Data Structures, Networking and OS Concepts
• Excellent coding skills (We prefer java).
• Flexible to work on any technology. Should be able to pick-up new technologies fast.
• Expertise in any programming language
• Good knowledge of relational databases and writing complex queries
• Good knowledge of web 2.0 technologies
• Knowledge of distributed systems, Multi-threading, network programming.
• Exhibit passion and enthusiasm for building and maintaining large scale platforms.
• Passionate about automated testing, good design, performance and scalability.
• Able to solve complex algorithms
• Excellent analytical, logical and problem-solving skills
As a web application developer, your job is to program frontend modules and applications. We are looking for someone with expertise and experience in designing, developing and testing web applications including new developments, enhancements, maintenance and support. The role involves continuous collaboration with team, partners.
Responsibility
- Building interactive consumer data from multiple systems and RESTfully abstract to the UI using React JS ( javascript and typescript) through a Node.js backend
- Create Unit and Integration tests to ensure the quality of code
- Address and improve any technical issues
- Ability to translate Wireframes and PSD Designs into functional web apps
- Be responsive to change requests and feature requests
- Write code that is cross-platform and cross-device compatible
- Strong commitment to quality and delivery
- Collaborate well with engineers, and specialists to design and create advanced, elegant and efficient system
Requirements:
- Experience creating front end applications using HTML, React JS
- Database – MongoDB, SQL
- Fluent knowledge of latest HTML/CSS standards and best practices
- Experience building Responsive websites for web, tablet and mobile device
- Obsession with lean, clean and organized code
- Solid Understanding of HTTP protocol and how server-side code is processed on the client
- Knowledge of the following will be considered as an advantage
Consumer Web Development Experience for High-Traffic, Public Facing web applications
Experience with cloud technologies also a plus
Creating Unit test cases
Typescript
- 5to 7 years plus experience having implemented Adobe Experience Manager based Solution in a large scale environment
- Deep understanding of Adobe AEM, Apache Sling, Servlets
- Experience developing applications, templates, and components for the Adobe AEM product (WCM, DAM, CRX)
- Experience customizing workflows and integration with other enterprise systems
- Demonstrated experience with Java, JavaScript, HTML5, CSS3, and related technologies
- Expertise in Java, web development experience, and other Content management system experience.
- Great understanding of Web technologies like XML, HTML, Client Server-side scripting languages such as JavaScript, JSP, and web services development using RESTful implementations.
- Should have exposure on the continuous integration build tools and code quality tools
Responsibilities
- Develop digital consumer experiences based on a foundation of the Adobe AEM product suite, including AEM, CRX, Target, and DAM
- Translate marketing and website needs into AEM specific recommendations and solutions
- Leverage AEM, other state-of-the-art technologies, and integration patterns to solve cross-departmental challenges
- Design and improve internal development methodologies around Adobe AEM solution
- Develop front end and back end components using AEM
Immediate joinees would be preferred
JAVA spring boot, Micro services
Node JS
REST API consume and produce
Any DB SQL or NoSQL







