Azure DevOps + Python

We are looking for a skilled and motivated Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) data pipelines. The role involves working with various GCP services, implementing data ingestion and transformation logic, and ensuring data quality and consistency across systems.

Key Responsibilities:

• Design, develop, test, and maintain scalable ETL data pipelines using Python.
• Work extensively on Google Cloud Platform (GCP) services such as:
• Dataflow for real-time and batch data processing
• Cloud Functions for lightweight serverless compute
• BigQuery for data warehousing and analytics
• Cloud Composer for orchestration of data workflows (based on Apache Airflow)
• Google Cloud Storage (GCS) for managing data at scale
• IAM for access control and security
• Cloud Run for containerized applications
• Perform data ingestion from various sources and apply transformation and cleansing logic to ensure high-quality data delivery.
• Implement and enforce data quality checks, validation rules, and monitoring.
• Collaborate with data scientists, analysts, and other engineering teams to understand data needs and deliver efficient data solutions.
• Manage version control using GitHub and participate in CI/CD pipeline deployments for data projects.
• Write complex SQL queries for data extraction and validation from relational databases such as SQL Server, Oracle, or PostgreSQL.
• Document pipeline designs, data flow diagrams, and operational support procedures.
• 
  

Required Skills:

• 4–8 years of hands-on experience in Python for backend or data engineering projects.
• Strong understanding and working experience with GCP cloud services (especially Dataflow, BigQuery, Cloud Functions, Cloud Composer, etc.).
• Solid understanding of data pipeline architecture, data integration, and transformation techniques.
• Experience in working with version control systems like GitHub and knowledge of CI/CD practices.
• Strong experience in SQL with at least one enterprise database (SQL Server, Oracle, PostgreSQL, etc.).

About the Role-

Thinking big and executing beyond what is expected. The challenges cut across algorithmic problem solving, systems engineering, machine learning and infrastructure at a massive scale.

Reason to Join-

An opportunity for innovators, problem solvers & learners.  Working will be Innovative, empowering, rewarding & fun. Amazing Office, competitive pay along with excellent benefits package.

Requiremets and Responsibilities- (please read carefully before applying)

• The overall experience of 3-6 years in Java/Python Framework and Machine Learning.
• Develop Web Services, REST, XSD, XML technologies, Java, Python, AWS, API.
• Experience on Elastic Search or SOLR or Lucene -Search Engine, Text Mining, Indexing.
• Experience in highly scalable tools like Kafka, Spark, Aerospike, etc.
• Hands on experience in Design, Architecture, Implementation, Performance & Scalability, and Distributed Systems.
• Design, implement, and deploy highly scalable and reliable systems.
• Troubleshoot Solr indexing process and querying engine.
• Bachelors or Masters in Computer Science from Tier 1 Institutions

Must have:

• 8+ years of experience with a significant focus on developing, deploying & supporting AI solutions in production environments.
• Proven experience in building enterprise software products for B2B businesses, particularly in the supply chain domain.
• Good understanding of Generics, OOPs concepts & Design Patterns
• Solid engineering and coding skills. Ability to write high-performance production quality code in Python
• Proficiency with ML libraries and frameworks (e.g., Pandas, TensorFlow, PyTorch, scikit-learn).
• Strong expertise in time series forecasting using stat, ML, DL and foundation models
• Experience of working on processing time series data employing techniques such as decomposition, clustering, outlier detection & treatment
• Exposure to generative AI models and agent architectures on platforms such as AWS Bedrock, Crew AI, Mosaic/Databricks, Azure
• Experience of working with modern data architectures, including data lakes and data warehouses, having leveraged one or more of the frameworks such as Airbyte, Airflow, Dagster, AWS Glue, Snowflake,, DBT
• Hands-on experience with cloud platforms (e.g., AWS, Azure, GCP) and deploying ML models in cloud environments.
• Excellent problem-solving skills and the ability to work independently as well as in a collaborative team environment.
• Effective communication skills, with the ability to convey complex technical concepts to non-technical stakeholders

Good To Have:

• Experience with MLOps tools and practices for continuous integration and deployment of ML models.
• Has familiarity with deploying applications on Kubernetes
• Knowledge of supply chain management principles and challenges.
• A Master's or Ph.D. in Computer Science, Machine Learning, Data Science, or a related field is preferred

Kindly do not apply if you have less than 4 Yrs of Experience in Python

Position(6 Months Contract in Gurugram, India) :

Sr. Software Engineer

Experience:

4+ years of relevant exp

Location:

Gurugram, India

(Note: FREE accommodation can be given in Gurgaon, India for the 6 months & 'work from home' is not allowed)

About Company:

The company for which you will be working is an online insurance provider that operates a B2C platform as well as a B2B2C platform. They are working to revolutionize the way insurance is bought in India by not only offering an online platform but also providing every customer a touchpoint with its partners. The company has been a platform for Motor, Health, Travel, & Life Insurance.

Key Competencies:

• A strong technical solutioning sense.
• Excellent experience in writing code using the following technologies: Python and Django.
• Can write elegant and performant SQL queries.
• Understand end-user requirements, formulate use cases and come up with effective solutions.
• Strong problem-solving, data structures, and algorithm design skills.
• Good understanding of REST APIs and web technologies in general.
• Very good understanding of any RDBMS like MySQL and PostgreSQL.
• Knowledge of NoSQL databases.
• Ability to build a feature from scratch & drive it to completion.
• A willingness to learn and choose new technologies with a strong justification for the choices made.

Roles/Responsibilities:

• Be involved in all aspects of development: playing a critical role in the design, planning, development, testing, and deployment.
• Help develop best practices for future development.
• Thinks and implements in the right way instead of cutting corners.
• Conceptualize, Design, and Develop new features in the product.
• Integrate user-facing elements into applications, test & debug programs
• Own the delivery of an entire piece of a system or application.
• Use technical knowledge and creative thinking to provide the most innovative solutions.
• Optimizing the performance of the components and keeping up to date with the latest industry trends
• Doing effective peer reviews where your peers learn from you every time.
• Be a great team player

If interested, please share your CV with kuldeep[dot]pandey[@]benchkart[dot]com

Requirements:

• Passion for building and delivering great software with a strong sense of ownership.
• Good understanding into .Net Core and PS
• Minimum of two years of experience in building web applications using ASP.NET MVC and .NET platform in general.
• Should have strong UI development skills using HTML, CSS/JavaScript frameworks.-

     Good understanding of IIS configuration

• Strong experience with Build and Release, Agile processes and Estimation/Planning-
  
  Exposure to New Relic or similar tools to optimize web application performance
  Strong expertise in SQL programming, with experience of writing & optimizing queries that access/process millions of records-
  Experience of architecting and designing web applications and servicesTeam TA,LeadSquared (ref:hirist.com)