
Data Engineer
at consulting & implementation services in the area of Oil & Gas, Mining and Manufacturing Industry
- Data Engineer
Required skill set: AWS GLUE, AWS LAMBDA, AWS SNS/SQS, AWS ATHENA, SPARK, SNOWFLAKE, PYTHON
Mandatory Requirements
- Experience in AWS Glue
- Experience in Apache Parquet
- Proficient in AWS S3 and data lake
- Knowledge of Snowflake
- Understanding of file-based ingestion best practices.
- Scripting language - Python & pyspark
CORE RESPONSIBILITIES
- Create and manage cloud resources in AWS
- Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, REST HTTP API, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies
- Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform
- Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations
- Develop an infrastructure to collect, transform, combine and publish/distribute customer data.
- Define process improvement opportunities to optimize data collection, insights and displays.
- Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible
- Identify and interpret trends and patterns from complex data sets
- Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders.
- Key participant in regular Scrum ceremonies with the agile teams
- Proficient at developing queries, writing reports and presenting findings
- Mentor junior members and bring best industry practices
QUALIFICATIONS
- 5-7+ years’ experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales)
- Strong background in math, statistics, computer science, data science or related discipline
- Advanced knowledge one of language: Java, Scala, Python, C#
- Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake
- Proficient with
- Data mining/programming tools (e.g. SAS, SQL, R, Python)
- Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)
- Data visualization (e.g. Tableau, Looker, MicroStrategy)
- Comfortable learning about and deploying new technologies and tools.
- Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines.
- Good written and oral communication skills and ability to present results to non-technical audiences
- Knowledge of business intelligence and analytical tools, technologies and techniques.
Familiarity and experience in the following is a plus:
- AWS certification
- Spark Streaming
- Kafka Streaming / Kafka Connect
- ELK Stack
- Cassandra / MongoDB
- CI/CD: Jenkins, GitLab, Jira, Confluence other related tools

Similar jobs
Job Title : React.js Developer with PWA Studio
Location : Remote
Experience : 10+ Years
Job Description :
We are looking for a highly experienced Frontend Developer with a strong background in React.js and PWA Studio to work on cutting-edge eCommerce solutions built on the Magento platform.
This role requires deep expertise in Progressive Web App development (PWA), frontend architecture, and performance optimization.
Mandatory Skills :
React.js, Next.js, PWA Studio, Magento 2.x integration, JavaScript (ES6+), HTML5, CSS3, Redux, RESTful APIs, GraphQL, Git, performance optimization, responsive design.
Key Responsibilities :
- Design and develop high-performance, scalable front-end solutions using React.js and Next.js.
- Build and optimize Progressive Web Apps (PWAs) using Magento PWA Studio.
- Collaborate with backend developers to integrate with Magento 2.x APIs and ensure seamless user experiences.
- Implement and maintain responsive UI components using HTML5, CSS3, JavaScript (ES6+), React, and Redux.
- Optimize application performance using tools like Lighthouse, Webpack, and advanced code-splitting techniques.
- Develop and maintain robust CI/CD pipelines and manage deployments via Vercel.
- Ensure high code quality by writing unit and integration tests using frameworks such as Jest, Mocha, or Cypress.
- Work closely with product and design teams in an Agile environment to deliver user-centric solutions.
Mandatory Skills :
- 10+ years of frontend development experience.
- Expert in React.js, Next.js, and JavaScript (ES6+).
- Hands-on experience with Magento PWA Studio.
- Proficient in HTML5, CSS3, Redux, and responsive design.
- Deep understanding of RESTful APIs and GraphQL.
- Strong knowledge of Git and version control best practices.
- Solid experience in performance optimization for web applications.
Good to Have :
- Experience with Magento 2.x backend.
- Prior experience deploying frontend apps with Vercel.
- Familiarity with serverless architecture and CI/CD in cloud environments.
What you'll do:
· Perform complex application programming activities with an emphasis on mobile development: Angular, Node, TypeScript, JavaScript, Apache Cordova, RESTful APIs and more
· Assist in the definition of system architecture and detailed solution design that are scalable and extensible
· Collaborate with Product Owners, Designers, and other engineers on different permutations to find the best solution possible
· Own the quality of code and do your own testing. Automate feature testing and contribute UI testing framework
· Become a subject matter expert for our mobile applications
· Deliver amazing solutions to production that knock everyone’s socks off
· Mentor junior developers on the team
What we’re looking for:
· Amazing technical instincts. You know how to evaluate and choose the right technology and approach for the job. You have stories you could share about what problem you thought you were solving at first, but through testing and iteration, came to solve a much bigger and better problem that resulted in positive outcomes all-around.
· A love for learning. Technology is continually evolving around us, and you want to keep up to date to ensure we are using the right tech at the right time.
· A love for working in ambiguity—and making sense of it. You can take in a lot of disparate information and find common themes, recommend clear paths forward and iterate along the way. You don’t form an opinion and sell it as if it’s gospel; this is all about being flexible, agile, dependable, and responsive in the face of many moving parts.
· Confidence, not ego. You have an ability to collaborate with others and see all sides of the coin to come to the best solution for everyone.
· Flexible and willing to accept change in priorities, as necessary
Basic Qualifications:
· Minimum B.S. / M.S. Computer Science or related discipline from accredited college or University
· At least 6 years of experience designing, developing, and delivering web applications with Angular, Node, Typescript, IONIC and JavaScript
· At least 2 years of experience building iOS-based applications utilizing hybrid technologies
· At least 2 years of experience with AWS and/or Openshift
· Experience integrating with native device API’s (iOS)
· Experience with front-end and/or mobile-specific testing frameworks
· Strong experience in object-oriented design and development
· Knowledge of building and consuming RESTful APIs
· Excellent sense of web design, passionate about creating and refining great mobile user experiences.
· Ability to manage multiple tasks and consistently meet established timelines
· Strong collaboration skills
· Excellent written and verbal communications skills
Preferred Qualifications:
· Proficient with Apache Cordova framework
· Built or maintained custom Cordova plugin
-
Demonstrable knowledge of native coding background in iOS
· Understanding of Apple certificate and profile management
· Experience developing and deploying applications within Kubernetes based containers
· Experience in Agile and SCRUM development techniques
- Identifying potential clients through market research
- Making calls to generate leads, and helping to develop lead generation strategies
- Communicating with clients, answering questions, and scheduling presentations and follow-ups
- Assisting the sales department, which may include participating in meetings, managing email campaigns, and making cold calls
- Maintaining databases
- Contributing to data analysis to develop lead generation strategies
- Compiling weekly and monthly reports on key accounts, monitoring inventory and sell-through, and submitting recommendations
Roles and Responsibilities:
1.Must have good analytical and problem solving skills.
2.Works as a Project Manager and reports directly to CTO/ VP
3.Manage daily/weekly scrums.
4.Able to perform and follow coding standards.
5.Perform R&D tasks if assigned and communicate with the Designer and UI team.
6.Taking leadership responsibilities and handling the team well
Responsibilities:
Respond to customer queries in a timely and accurate way, via phone.
Identify customer needs and help customers use specific features.
Inform customers about new features and functionalities.
Gather customer feedback and share with our Product, Sales and Marketing teams.
Shift Timing: 1pm-9.30pm (UK)
8pm-5am (US)
** Must have excellent communication skill in English .
Freshers also can apply.
Interview Mode: Face to face
Contact: Sanjukta (HR) @ 90381^69266/ sanjukta.seal at the rate adretsoftware.com
Job description
We are looking for MERN Stack Interns to join our team and help us build and maintain high-performance web applications. As a MERN stack developer, you will be responsible for designing, developing, and deploying web applications using the MERN stack (MongoDB, Express, React, and Node.js).
Key Responsibilities:
- Design and develop web applications using the MERN stack
- Write clean, maintainable, and efficient code
- Collaborate with the team to define, design, and ship new features
- Troubleshoot, debug, and optimize the application
- Stay up-to-date with the latest industry trends and technologies
- Participate in code reviews and ensure the code is maintainable and scalable
Qualifications:
- Strong knowledge of JavaScript.
- Familiar with MongoDB, Express, React, and Node.js
- Familiar with web development concepts such as RESTful API design, authentication and authorization, and front-end optimization.
- Familiar with Git, webpack, and other development tools.
- Strong problem-solving skills and ability to debug and optimize code.
- Strong communication and documentation skills.
- Must have a bachelor's/master's degree in Computer Science.
If you are passionate about using the latest technologies to build high-performance web applications, we would love to hear from you!
Internship Duration: 06 Months.
Working Days: (Monday to Friday)
Timing: 9:30 AM to 6:30 PM
Job Location: Naini Prayagraj.
Note: This Job is the total based on Work from the Office & We prefer only UP candidates.
Job Types: Full-time, Internship
Salary: ₹5,000.00 per month
art of programming. Responsibilities will involve translating the UI/UX design wireframes
to actual code that will generate visual aspects of the application. You will collaborate with
the UI/UX designer to bridge the gap between graphical design and technical
implementation. You will play an active part on both sides and define how the program
appears as well as how it operates.
● Collaborating with web designers to talk about the layout and design of the project
● Coding the entire website from beginning to end
● Developing front-end web apps and code debugging
● Ensuring cross-platform compatibility
● Finding errors in applications and troubleshooting them
● Performing usability and performance testing on websites
Required skills for CSS/HTML5 developers
● Bachelor's degree in computer science, computer engineering, management
information systems, or a related field
● At least 3+ years of HTML/CSS development experience is required
● Proficiency with HTML5, CSS3, JavaScript, and XML
● Knowledge of troubleshooting code and application is highly desirable
● Ability to translate user requirements into code
● Familiarity with building intuitive front-end applications
Responsibilities:
- Build reusable code and libraries for future use.
- Own & build new modules/features end-to-end independently.
- Collaborate with other team members and stakeholders.
Requirements:
- Thorough understanding of Node.js, JavaScript, its quirks, and workarounds.
- Excellence in at least one framework like strongloop loopback, express.js, sail.js etc.
- Excellence in at least one Javascript framework like Angular, vue.js, Ember, React or Backbone.
- Basic architectural understanding of modern day web applications.
- Diligence for coding standards.
- Must be good with git and git workflow.
- Experience of external integrations is a plus.
- Working knowledge of AWS, GCC, Azure.
- Expertise with linux based systems.
- Experience with CI/CD tools like jenkins is a plus.
- Experience with testing and automation frameworks.
- Extensive understanding of RDBMS systems.
- Interpersonal Go-getter attitude and a passion for making killer web applications.
- Good communication and interpersonal skills.
- Ability to work in a high pressure environment.
- Ability to quickly understand complex problems and devise effective solutions.
- Knowledge of D3/NodeJS/AngularJS/lodash etc.
- Experience on Cloud as a platform or Infrastructure.
- Inclination to application design standards.










