Python
GitHubRole: Sr. Azure Data Engineer
Experience: 8–10 Years
Work Timings: 1:30 PM – 10:30 PM IST
Location: Bellandur Bengaluru (Work from Office)
Company: Chevron
Employment Type: 6- 12 months Contract
Role Overview
We are seeking an experienced Senior Data Engineer to design and deliver scalable cloud data solutions on Azure. The ideal candidate will have strong expertise in Databricks, PySpark, and modern data architectures, with exposure to energy domain standards like OSDU.
Key Responsibilities
- Architect and design robust Azure-based data solutions using Databricks, ADLS, and PaaS services
- Define and implement scalable data Lakehouse architectures aligned with OSDU standards
- Build and manage end-to-end data pipelines for batch and real-time processing using PySpark
- Establish data governance frameworks including metadata, lineage, security, and access control
- Implement DevOps best practices (CI/CD, Azure Pipelines, GitHub, automated deployments)
- Collaborate with stakeholders to translate business needs into technical solutions
- Develop and maintain architecture documentation, solution patterns, and standards
- Provide technical leadership and mentorship to engineering teams
- Optimize solutions for performance, cost, reliability, and security
- Ensure alignment with enterprise architecture and compliance standards
- Drive adoption of modular and reusable cloud data components
Required Skills & Qualifications
Core Technical Skills
- Azure Databricks, Apache Spark (PySpark), Delta Lake, Unity Catalog
- Azure Data Lake Storage (ADLS), Azure Data Factory, Synapse Analytics
- Strong experience in Python-based data engineering
- Data pipeline development (batch + real-time)
Architecture & Advanced Skills
- Data Lakehouse architecture and distributed systems
- Microservices, APIs, and integration frameworks
- OSDU (Open Subsurface Data Universe) or similar energy data models
DevOps & Tools
- CI/CD tools: Azure Pipelines, GitHub Actions
- Infrastructure as Code: Terraform or similar
Other Skills
- Data governance, security, compliance, and cost optimization
- Strong analytical and problem-solving skills
- Excellent communication and stakeholder management
Shubham Vishwakarma
Full Stack Developer - Averlon
Similar jobs
JavaPython
Amazon Web Services (AWS)Job Details
- Job Title: Lead Software Engineer - Java, Python, API Development
- Industry: Global digital transformation solutions provider
- Domain - Information technology (IT)
- Experience Required: 8-10 years
- Employment Type: Full Time
- Job Location: Pune & Trivandrum/ Thiruvananthapuram
- CTC Range: Best in Industry
Job Description
Job Summary
We are seeking a Lead Software Engineer with strong hands-on expertise in Java and Python to design, build, and optimize scalable backend applications and APIs. The ideal candidate will bring deep experience in cloud technologies, large-scale data processing, and leading the design of high-performance, reliable backend systems.
Key Responsibilities
- Design, develop, and maintain backend services and APIs using Java and Python
- Build and optimize Java-based APIs for large-scale data processing
- Ensure high performance, scalability, and reliability of backend systems
- Architect and manage backend services on cloud platforms (AWS, GCP, or Azure)
- Collaborate with cross-functional teams to deliver production-ready solutions
- Lead technical design discussions and guide best practices
Requirements
- 8+ years of experience in backend software development
- Strong proficiency in Java and Python
- Proven experience building scalable APIs and data-driven applications
- Hands-on experience with cloud services and distributed systems
- Solid understanding of databases, microservices, and API performance optimization
Nice to Have
- Experience with Spring Boot, Flask, or FastAPI
- Familiarity with Docker, Kubernetes, and CI/CD pipelines
- Exposure to Kafka, Spark, or other big data tools
Skills
Java, Python, API Development, Data Processing, AWS Backend
Skills: Java, API development, Data Processing, AWS backend, Python,
Must-Haves
Java (8+ years), Python (8+ years), API Development (8+ years), Cloud Services (AWS/GCP/Azure), Database & Microservices
8+ years of experience in backend software development
Strong proficiency in Java and Python
Proven experience building scalable APIs and data-driven applications
Hands-on experience with cloud services and distributed systems
Solid understanding of databases, microservices, and API performance optimization
Mandatory Skills: Java API AND AWS
******
Notice period - 0 to 15 days only
Job stability is mandatory
Location: Pune, Trivandrum
JavaPython
Go Programming (Golang)
NodeJS (Node.js)
Spring BootArchitect, develop and maintain highly scalable, reliable and secure distributed backend
systems on Cloud (AWS or Azure) or on-premises environments for Mihup, its customers
and partners.
Work closely with your fellow engineers to develop systems capable of concurrently
processing massive amounts of voice data both in online real-time as well as offline
environments.
Drive accountability for test driven development, delivery of high-quality features and
resilient enterprise class solutions.
Lead a culture of team ownership and direct individual and team accountability to
continuously improve how they work to achieve results.
Work in a startup environment, pushing boundaries with deep involvement with business.
BE//BTech/ME/MTech in Computer Science or a related field from a Tier I or Tier II
University.
6-8 years of hands-on software development and deployment experience (experience of
working in a consumer product startup during its growth phase will be a plus) of which 1 – 2
years of experience would be in leading a team of software developers.
Expertise in Java 8+ and Spring Boot is a must
Good experience in messaging platforms like RabbitMQ/Kafka
Good experience in distributed systems and relational & NoSQL databases like PostgreSQL,
MySQL, Redis, MongoDB, etc.
Expertise in one or more of: Python, NodeJS, GoLang would be preferred
Must have hands on experience in products which handle multiple concurrent calls (API),
handle CPU intensive jobs, consist of multiple asynchronous system calls.
Worked on microservices based architecture and design
Managed/ Owned infrastructure on AWS/Microsoft Azure/private clouds and setup high
availability systems
Knowledge of Docker and Kubernetes
Knowledge of RESTful APIs, caching concepts, the HTTP protocol and general web
architecture
Pluses
1. Anything that will let us know more about who you are that you would like to share such as
Blogs, Twitter, Medium, GitHub etc.
Python
Machine Learning (ML)Must have:
- 8+ years of experience with a significant focus on developing, deploying & supporting AI solutions in production environments.
- Proven experience in building enterprise software products for B2B businesses, particularly in the supply chain domain.
- Good understanding of Generics, OOPs concepts & Design Patterns
- Solid engineering and coding skills. Ability to write high-performance production quality code in Python
- Proficiency with ML libraries and frameworks (e.g., Pandas, TensorFlow, PyTorch, scikit-learn).
- Strong expertise in time series forecasting using stat, ML, DL and foundation models
- Experience of working on processing time series data employing techniques such as decomposition, clustering, outlier detection & treatment
- Exposure to generative AI models and agent architectures on platforms such as AWS Bedrock, Crew AI, Mosaic/Databricks, Azure
- Experience of working with modern data architectures, including data lakes and data warehouses, having leveraged one or more of the frameworks such as Airbyte, Airflow, Dagster, AWS Glue, Snowflake,, DBT
- Hands-on experience with cloud platforms (e.g., AWS, Azure, GCP) and deploying ML models in cloud environments.
- Excellent problem-solving skills and the ability to work independently as well as in a collaborative team environment.
- Effective communication skills, with the ability to convey complex technical concepts to non-technical stakeholders
Good To Have:
- Experience with MLOps tools and practices for continuous integration and deployment of ML models.
- Has familiarity with deploying applications on Kubernetes
- Knowledge of supply chain management principles and challenges.
- A Master's or Ph.D. in Computer Science, Machine Learning, Data Science, or a related field is preferred
NodeJS (Node.js)PythonAmazon Web Services (AWS)Skills:
Strong knowledge of MYSQL/PostGreSQL; Knowledge of MongoDB, Redis, Couch DB is preferred.
Expertise in application development, databases, version control, and deployment. Skill - Node.js,
Experience of AWS or GCP - especially services such as Lambda or google app engine
Solid grasp of Service-oriented architecture. Web Services implementation on a medium to large scale
Solid understanding of scaling mobile app services. Having worked the backend of an Android app is preferred
Culture:
Ability to work independently with minimal supervision
Happy to deal with, and contribute to, an environment of daily builds Has worked in small teams, is versatile. Work within short timelines and be receptive to business needs. Can work closely with Digital, Product, Operations teams.
Desirable Social Attributes:
Has contributed to one or more Open Source projects through own initiative. Has provided a high quality answer to a question posted on StackOverflow.
Role:
As a Software Developer who would work independently, the candidate is expected actively acquire problems and deliver solutions as well as guide the team technically. Such a problem solver would obviously be a self starter with a high level of curiosity rather than a programming language specialist.
He/she would be required to produce software of the highest quality through self-discipline, clear and engaged communication, and attention to detail. The role would include custom web application development on (most typically on Node.js and PHP/Python), databases (most typically MySql and MongoDb), version control (github), testing (necessarily through test scripts written before code is written), daily builds and eventual deployment onto AWS or GCP.
Attributes of the ideal candidate:
Highly productive software developer with the proven aptitude to understand and apply technology
Determination to succeed despite obstacles and challenges, and a positive attitude favoring achievement of goals over open-ended investigation
Always learning, evolving, and sharing what you know
Inspired by complex, varied problems and rapid change
Open-minded, flexible, and curious about new and better ideas
PythonCoincrowd we are hiring Backend / Fullstack developers ( Python Django )
Position - Python Django / flask developer
Experienced required - 3-6 years
Location - India ( REMOTE )
Skills : Python, Django, Django Rest Framework, Jira, Mysql,MongoDB,eCommerce/ Finance domain
Ruby
Ruby on Rails (ROR)PythonPython
JenkinsProgramming Languages: Perl, java. Perl programming with strong OOPs knowledge.
UI: HTML, JS
System: Linux must have – good knowledge and shell scripting experience.
Prior experience in infrastructure automation, monitoring will definitely help.
Description:
The person in this role:
- Will be involved in developing new monitoring scripts, enhancement & defect fixes on existing monitors
- Have to be on-call to support any incoming production/P1 internal issues which need urgent attention (team members are on call for a week and we have a weekly rotation policy within the team)
Preferred skills:
- Perl
- Shell scripting
- Unix
- Jenkins
Python
Django
PostgreSQL
GitRole - Backend Developer
Experience:- 2+
Qualification:- BE Computer Engineering/MCA
Programming Language - Python & framework Django
Responsibilities
- Building REST API's & Services In Django Framework
- Building reusable code and libraries for future use
- Optimization of the application for maximum speed and scalability
- Implementation of security and data protection
- Design and implementation of the database schema
- Design and implementation of data storage solutions
- Implementing CI/CD pipeline
- Proficient knowledge of a back-end programming language Python
- Hands-on experience with Python Frameworks like Django
- Proficient knowledge of MySQL, PostgreSQL
- Creating database schemas that represent and support business processes (Relational & NoSQL)
- Understanding of queueing systems like Redis/AWS SQS
- User authentication and authorization between multiple systems, servers, and environments
- Data migration, transformation, and scripting
- Understanding differences between multiple delivery platforms such as mobile vs desktop, and optimizing output to match the specific platform
- Proficient understanding of code versioning tools, such as Git
Brownie Points
- Experience in Docker
- HandsOn Knowledge with implementing CI/CD pipelines
- Experience in managing applications on AWS
- Management of hosting environment, including database administration and scaling application to support load changes
- Product wide application-level thinking on API and data modeling
JavaPythonNodeJS (Node.js)- Experience in Web and Mobile Applications
- Agility and ability to adapt quickly to changing requirements and scope and priorities
- Experience in Java, Python.
- Deep understanding of data structures and microservices.
- Knowledge of Node.js
- Understanding the nature of asynchronous programming and its quirks and workarounds
- Familiarity with front-end technologies
- User authentication and authorization between multiple systems, servers, and environments
- Interaction with multiple data sources
- Good understanding of SQL
- Understanding fundamental design principles behind a scalable application
- Understanding differences between multiple delivery platforms, such as mobile vs. desktop, and optimizing output to match the specific platform.
- Implementing automated testing platforms and unit tests
- Proficient understanding of code versioning tools, such as Git .
NodeJS (Node.js)
Javascript
MongoDB
Angular (2+)Advanced proficiency in MEAN Stack (NodeJS, MongoDB, Express, Angular JS)
Proficiency and hands-on experience with one or more of the following: Backbone / Knockout JS / Ember JS / React JS
Knowledge of JQuery would be an added advantage
Thorough knowledge of software development best practices, including coding standards, code reviews, source control management, build process, continuous integration and continuous delivery
Thorough knowledge of Node.JS, MongoDB, Angular JS, Express JS and JavaScript
Ability to plan core architecture, and to enhance it from time to time
Strong analytical mindset to derive actionable analytics from data
Follow CutshortShubham Vishwakarma
Full Stack Developer - Averlon