Data Engineer
at world’s fastest growing consumer internet company
Data Engineer JD:
- Designing, developing, constructing, installing, testing and maintaining the complete data management & processing systems.
- Building highly scalable, robust, fault-tolerant, & secure user data platform adhering to data protection laws.
- Taking care of the complete ETL (Extract, Transform & Load) process.
- Ensuring architecture is planned in such a way that it meets all the business requirements.
- Exploring new ways of using existing data, to provide more insights out of it.
- Proposing ways to improve data quality, reliability & efficiency of the whole system.
- Creating data models to reduce system complexity and hence increase efficiency & reduce cost.
- Introducing new data management tools & technologies into the existing system to make it more efficient.
- Setting up monitoring and alarming on data pipeline jobs to detect failures and anomalies
What do we expect from you?
- BS/MS in Computer Science or equivalent experience
- 5 years of recent experience in Big Data Engineering.
- Good experience in working with Hadoop and Big Data technologies like HDFS, Pig, Hive, Zookeeper, Storm, Spark, Airflow and NoSQL systems
- Excellent programming and debugging skills in Java or Python.
- Apache spark, python, hands on experience in deploying ML models
- Has worked on streaming and realtime pipelines
- Experience with Apache Kafka or has worked with any of Spark Streaming, Flume or Storm
Focus Area:
R1 |
Data structure & Algorithms |
R2 |
Problem solving + Coding |
R3 |
Design (LLD) |
Similar jobs
Required Qualifications:
∙Bachelor’s degree in computer science, Information Technology, or related field, or equivalent experience.
∙5+ years of experience in a DevOps role, preferably for a SaaS or software company.
∙Expertise in cloud computing platforms (e.g., AWS, Azure, GCP).
∙Proficiency in scripting languages (e.g., Python, Bash, Ruby).
∙Extensive experience with CI/CD tools (e.g., Jenkins, GitLab CI, Travis CI).
∙Extensive experience with NGINX and similar web servers.
∙Strong knowledge of containerization and orchestration technologies (e.g., Docker, Kubernetes).
∙Familiarity with infrastructure-as-code tools (e.g. Terraform, CloudFormation).
∙Ability to work on-call as needed and respond to emergencies in a timely manner.
∙Experience with high transactional e-commerce platforms.
Preferred Qualifications:
∙Certifications in cloud computing or DevOps are a plus (e.g., AWS Certified DevOps Engineer,
Azure DevOps Engineer Expert).
∙Experience in a high availability, 24x7x365 environment.
∙Strong collaboration, communication, and interpersonal skills.
∙Ability to work independently and as part of a team.
• Work closely with the Recruiting leads and hiring managers.
• Procure people for different IT Requirements.
• Use niche platforms related to IT, to source potential candidates.
• Personally, conduct interviews, document the same, and report as the need arises.
• In addition to executing individual responsibility should be able to work in unison with the other departments with the Company’s growth perspective in mind.
• Keeping abreast of industry trends.
We are looking for an experienced Node.js developer to build Crypto and Blockchain applications from scratch. No prior experience in Crypto or Blockchain is required but if you have experience with the same then that’s definitely a huge plus.
- At least 5 years of software development experience.
- At least 2 years of experience with Node.js/serverless.
- Extensive knowledge of JavaScript-based back-end libraries and frameworks preferably serverless.
- Understanding the nature of asynchronous programming and its quirks and workarounds.
- Knowledge of front-end JavaScript libraries and frameworks such as react, angular etc.
- Experience with Java programming language will be a plus.
- Able to solve complex problems using suitable algorithms and data structures.
- Good understanding of RESTful APIs.
- Knowledge of both SQL and NoSQL databases such as MySQL, Oracle, MongoDB etc.
- Able to design scalable databases.
- Working experience of Git preferably bitbucket.
- Good knowledge of CI/CD preferably using bitbucket pipelines and Jenkins.
- Familiarity with AWS services such as API gateway, Lambda, DynamoDB, Cloudsearch/Elasticsearch.
- Working knowledge of agile methodologies and techniques.
- Prior experience in optimizing large scale systems using caching and load balancing will be a huge plus.
- Understanding fundamental design principles behind a scalable application.
What is the role?
We are looking for a hands-on Android Developer to join the mobile team for Empuls. The applicant must have Android software development skills, and a passion for delivering high-quality, rock-solid apps. Android programming works closely with other app development and technical teams.
Key Responsibilities
- Translate designs and wireframes into high-quality code.
- Design, build and maintain high performance, reusable, and reliable Java and Kotlin code
- Ensure the best possible performance, quality, and responsiveness of the application.
- Identify and correct bottlenecks and fix bugs.
- Help maintain code quality, organization, and automatization.
What are we looking for?
An enthusiastic individual with the following skills. Please do not hesitate to apply if you do not match all of it. We are open to promising candidates who are passionate about their work and are team players.
- Bachelor's degree or higher in Computer Science and a minimum of 4 years of Software Development experience.
- Knowledge of mobile automation and experience on platforms such as espresso.
- Knowledge of application profiling and performance monitoring tools such as Android profiler, AppDynamics, Dynatrace, etc.
- Excellent coding skills in an object-oriented language such as Java and Kotlin.
- Experience with offline storage, threading, and performance tuning
- Have published at least one original Android app.
- Understanding of Google's Android design principles and interface guidelines.
- Strong knowledge of Android UI design principles, patterns, and best practices.
- 12 to 16 years of experience in enterprise level software architecture, design, development (architecture, design patterns, reliability and scaling) of new and current systems
- Experienced in Full Stack product development
- Bachelor’s Degree in computer science or a related field
- Computer Science fundamentals in data structures, algorithm design and problem solving.
- Extensive knowledge and deep understanding of Java and related technologies
- Experience with modern software development methodologies: Agile/Kanban, CI/CD, DevOps, etc.
- Proficiency in Full Stack product development
- Proficiency with Java is essential.
- Proficiency with React, TypeScript, JavaScript, HTML CSS is essential
- Proficient with REST APIs
- Proficient with product development experience on both front end and back end
- Experience with AWS and/or other public cloud technologies.
- Database Experience (query optimization, index generation, caching) or NoSQL DBs a plus
Preferred Qualifications:
Job Title: Software Development Manager
Job Type: Full – Time
Location: Pune
Work Timings – General Shift
Main Job Tasks and Responsibilities:
- Provide project management and overall leadership on every aspect of the software and infrastructure
- Engage in external customer and client discussions at all stages of a project lifecycle as needed, including initial project scoping efforts through development and project presentation.
- Get involved to provide directions for different projects inclusive of research, development, design, evaluation, testing along with delivery.
- Supervise architecture planning and lead efforts to develop a technical roadmap for projects.
- Breakdown the Project stories into Sprints and ensure project completion on time by delegating, monitoring, and mitigating risks.
- Establish and stimulate software development standards and processes along with best practices.
- Perform closely with Engineers, Developers, and Product Management throughout the organization.
- Brainstorming new product development strategies and solutions.
- Constantly find ways to improve efficiency, introduce automation and smart measures for robust quality.
- Ensure quality design reviews to meet the customer’s SLA.
- Supervise resource allocation to assure the attainment of apt business and personnel development goals.
- Involve in strategic plans to accomplish technical as well as business with leadership chain, team, and customers.
- Evaluate projects, develop and update schedules plus supervise project status.
- Collaborate effectively with all team members as well as hold regular team meetings.
- Provide a safe and healthy environment for the team to develop and grow into highly productive, self-motivated, and competitive intellectuals
Skills and Experience:
Qualifications:
- BE/B-Tech/MBA in any related field.
- Experience: 5+ years
Skills:
- Strong Verbal and Written Communications Skills.
- Strong Relationship Building Ability with teams at all locations.
- Ability to work Collaboratively with various Verticals across multiple Geographical Locations.
- Ability to handle multiple projects simultaneously, efficiently & accurately.
- Should have technical knowledge of product development over Mobile, desktop, and enterprise infrastructure.
- Should have the ability to independently manage development from design through testing and deployment.
- Should have had experience tech stacks like MERN, MEAN, LAMP, or equivalent.
- UI experience is preferred.
- 2+ years of application development experience using Cloud technologies.
Personal Qualities and Behavior traits:
- Be a good team worker demonstrating loyalty and commitment to the organization and team members.
- Good organizational and communication skills and excellent attention to details
- Interact with individuals to facilitate information and feedback.