DSC Sales Manager

Job Description: Data Engineer

Location: Remote

Experience Required: 6 to 12 years in Data Engineering

Employment Type: [Full-time]

Notice: Looking for candidates, Who can join immediately or 15days Max

About the Role:

We are looking for a highly skilled Data Engineer with extensive experience in Python, Databricks, and Azure services. The ideal candidate will have a strong background in building and optimizing ETL processes, managing large-scale data infrastructures, and implementing data transformation and modeling tasks.

Key Responsibilities:

ETL Development:

Use Python as an ETL tool to read data from various sources, perform data type transformations, handle errors, implement logging mechanisms, and load data into Databricks-managed delta tables.

Develop robust data pipelines to support analytics and reporting needs.

Data Transformation & Optimization:

Perform data transformations and evaluations within Databricks.

Work on optimizing data workflows for performance and scalability.

Azure Expertise:

Implement and manage Azure services, including Azure SQL Database, Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake.

Coding & Development:

Utilize Python for complex tasks involving classes, objects, methods, dictionaries, loops, packages, wheel files, and database connectivity.

Write scalable and maintainable code to manage streaming and batch data processing.

Cloud & Infrastructure Management:

Leverage Spark, Scala, and cloud-based solutions to design and maintain large-scale data infrastructures.

Work with cloud data warehouses, data lakes, and storage formats.

Project Leadership:

Lead data engineering projects and collaborate with cross-functional teams to deliver solutions on time.

Required Skills & Qualifications:

Technical Proficiency:

• Expertise in Python for ETL and data pipeline development.
• Strong experience with Databricks and Apache Spark.
• Proven skills in handling Azure services, including Azure SQL Database, Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake.

Experience & Knowledge:

• Minimum 6+ years of experience in data engineering.
• Solid understanding of data modeling, ETL processes, and optimizing data pipelines.
• Familiarity with Unix shell scripting and scheduling tools.

Other Skills:

• Knowledge of cloud warehouses and storage formats.
• Experience in handling large-scale data infrastructures and streaming data.

Preferred Qualifications:

• Proven experience with Spark and Scala for big data processing.
• Prior experience in leading or mentoring data engineering teams.
• Hands-on experience with end-to-end project lifecycle in data engineering.

What We Offer:

• Opportunity to work on challenging and impactful data projects.
• A collaborative and innovative work environment.
• Competitive compensation and benefits.

How to Apply:

https://cloudesign.keka.com/careers/jobdetails/73555

About the Company-

AdPushup is an award-winning ad revenue optimization platform and Google Certified Publishing Partner (GCPP), helping hundreds of web publishers grow their revenue using cutting-edge technology, premium demand partnerships, and proven ad ops expertise.

Our team is a mix of engineers, marketers, product evangelists, and customer success specialists, united by a common goal of helping publishers succeed. We have a work culture that values expertise, ownership, and a collaborative spirit.

Job Overview- Java Backend- Lead Role :-

We are seeking a highly skilled and motivated Software Engineering Team Lead to join our dynamic team. The ideal candidate will have a strong technical background, proven leadership experience, and a passion for mentoring and developing a team of talented engineers. This role will be pivotal in driving the successful delivery of high-quality software solutions and fostering a collaborative and innovative work environment.

Exp- 5+ years

Location- New Delhi

Work Mode- Hybrid

Key Responsibilities:-

● Leadership and Mentorship: Lead, mentor, and develop a team of software engineers, fostering an environment of continuous improvement and professional growth.

● Project Management: Oversee the planning, execution, and delivery of software projects, ensuring they meet quality standards, timelines, and budget constraints.

● Technical Expertise: Provide technical guidance and expertise in software design, architecture, development, and best practices. Stay updated with the latest industry trends and technologies. Design, develop, and maintain high-quality applications, taking full, end-to-end ownership, including writing test cases, setting up monitoring, etc.

● Collaboration: Work closely with cross-functional teams to define project requirements, scope, and deliverables.

● Code Review and Quality Assurance: Conduct code reviews to ensure adherence to coding standards, best practices, and overall software quality. Implement and enforce quality assurance processes.

● Problem Solving: Identify, troubleshoot, and resolve technical challenges and bottlenecks. Provide innovative solutions to complex problems.

● Performance Management: Set clear performance expectations, provide regular feedback, and conduct performance evaluations for team members.

● Documentation: Ensure comprehensive documentation of code, processes, and project-related information.

Qualifications:-

● Education: Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related field.

● Experience: Minimum of 5 years of experience in software development.

● Technical Skills:

○ A strong body of prior backend work, successfully delivered in production. Experience building large volume data processing pipelines will be an added bonus.

○ Expertise in Core Java.

■ In-depth knowledge of the Java concurrency framework.

■ Sound knowledge of concepts like exception handling, garbage collection, and generics.

■ Experience in writing unit test cases, using any framework.

■ Hands-on experience with lambdas and streams.

■ Experience in using build tools like Maven and Ant.

○ Good understanding and Hands on experience of any Java frameworks e.g. SpringBoot, Vert.x will be an added advantage.

○ Good understanding of security best practices. ○ Hands-on experience with Low Level and High Level Design Practices and Patterns.

○ Hands on experience with any of the cloud platforms such as AWS, Azure, and Google Cloud.

○ Familiarity with containerization and orchestration tools like Docker, Kubernetes and Terraform.

○ Strong understanding of database technologies, both SQL (e.g., MySQL, PostgreSQL) and NoSQL (e.g., MongoDB, Couchbase).

○ Knowledge of DevOps practices and tools such as Jenkins, CI/CD.

○ Strong understanding of software development methodologies (e.g., Agile, Scrum).

● Leadership Skills: Proven ability to lead, mentor, and inspire a team of engineers. Excellent interpersonal and communication skills.

● Problem-Solving Skills: Strong analytical and problem-solving abilities. Ability to think critically and provide innovative solutions.

● Project Management: Experience in managing software projects from conception to delivery. Strong organizational and time-management skills.

● Collaboration: Ability to work effectively in a cross-functional team environment. Strong collaboration and stakeholder management skills.

● Adaptability: Ability to thrive in a fast-paced, dynamic environment and adapt to changing priorities and requirements.

Why Should You Work for AdPushup?

At AdPushup, we have

1. A culture of valuing our employees and promoting an autonomous, transparent, and ethical work environment.

2. Talented and supportive peers who value your contributions.

3. Challenging opportunities: learning happens outside the comfort-zone and that’s where our team likes to be - always pushing the boundaries and growing personally and professionally.

4. Flexibility to work from home: We believe in work & performance instead of measuring conventional benchmarks like work-hours.

5. Plenty of snacks and catered lunch.

6. Transparency: an open, honest and direct communication with co-workers and business associates.

we are looking for a talented and passionate Python Engineer to join our team. As part of our Insights backend team, you will be building new and improving existing services powering the Insights platform. This is a fast-paced role with high growth, visibility, impact, and where many of the decisions for new projects will be driven by you and your team from inception through production. If you are seeking an environment where you get to do meaningful work with other great engineers, then we want to hear from you!

Skills & Requirements

• At least 1 years of experience with Python, Django.
• Well versed in building the backend logic of web applications.
• Strong database skills.
• Solid foundation in designing and developing scalable API’s.
• Understanding of general web architecture.
• A Bachelors, Masters, or PhD in Computer Science, Information Technology, Computer Engineering or some related discipline, or equivalent experience.
• Hands on experience with Django, Flask or other Python frameworks.
• Basic understanding of front-end technologies, such as JavaScript, HTML5, and CSS3.
• Debugging applications to ensure low-latency and high-availability.
• Integrating user-facing elements with server-side logic.
• Implementing security and data protection.

Good to have skills :

• Excellent interpersonal, organizational, written communication, oral communication and listening skills.
• Should come up with the work estimation and should provide inputs to managers on resource and risk planning.
• Ability to coordinate with, stakeholders, manage timelines, escalation & provide on time status.
• Familiarity with some ORM (Object Relational Mapper) libraries.
• Web frameworks and RESTful APIs experience.

Salary: ₹600,000.00 - ₹700,000.00 per year

Job Type: Full-time

Benefits: Leave encashment ,Paid sick time

Schedule: Day shift

Supplemental pay types: Performance bonus

Ability to commute/relocate: Lucknow, Uttar Pradesh: Reliably commute or planning to relocate before starting work (Required)

Education: Bachelor's (Preferred)

A proficient, independent contributor that assists in technical design, development, implementation, and support of data pipelines; beginning to invest in less-experienced engineers.

Responsibilities:

- Design, Create and maintain on premise and cloud based data integration pipelines. 
- Assemble large, complex data sets that meet functional/non functional business requirements.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources.
- Build analytics tools that utilize the data pipeline to provide actionable insights into key business performance metrics.
- Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
- Create data pipelines to enable BI, Analytics and Data Science teams that assist them in building and optimizing their systems
- Assists in the onboarding, training and development of team members.
- Reviews code changes and pull requests for standardization and best practices
- Evolve existing development to be automated, scalable, resilient, self-serve platforms
- Assist the team in the design and requirements gathering for technical and non technical work to drive the direction of projects

Technical & Business Expertise:

-Hands on integration experience in SSIS/Mulesoft
- Hands on experience Azure Synapse
- Proven advanced level of writing database experience in SQL Server
- Proven advanced level of understanding about Data Lake
- Proven intermediate level of writing Python or similar programming language
- Intermediate understanding of Cloud Platforms (GCP) 
- Intermediate understanding of Data Warehousing
- Advanced Understanding of Source Control (Github)

Online tutoring platform that focuses on connecting students with tutors and has a focus on live learning courses for Science, Technology, Engineering, the Arts and Mathematics (STEAM) subjects. It is a global online school for 21st century skills, teaching Coding and other extra-curriculars to kids age 5-18 via LIVE, interactive, gamified online sessions that work 10x better than status quo.

• 2+ years of experience on NodeJS & React JS
• Practical experience in building APIs
• Experience with RabbitMQ or similar queuing system
• Experience with Redis/ElasticSearch is a plus
• Familiarity with CI/CD pipeline tools like Jenkins
• Practical experience with Git
• A knack for benchmarking and optimization

Description:

1. Hands-on backend web and API development experience.

2. Has strong MySQL and Database knowledge.

3. Working experience in building and deploying applications on servers like AWS, etc.

4. Good understanding of architectural patterns (e.g., MVC) is required.

5. Good communication and analytical skills.

6. Experience in building REST APIs in NodeJS and/or TypeScript.

7. Code repositories management in GIT.

8. Provide leadership to the team around new approaches, workflows, and technologies.

9. Experience in client requirement analysis and estimating projects timeline and efforts.