
We have urgent requirement of Data Engineer/Sr Data Engineer for reputed MNC company.
Exp: 4-9yrs
Location: Pune/Bangalore/Hyderabad
Skills: We need candidate either Python AWS or Pyspark AWS or Spark Scala

Similar jobs
1.Wordpress Development
2.PHP Programming
3.OOPS Concepts in PHP
4.Advanced custom and Security Plugins
5.Good Problem Solving skills.
6. Ability to create/tweak existing plugins
7. Ability to create multiple dashboards apart from admin dashboard
8.Good Knowledge in DB - MySQL/PostGreSQL
9.Ability to debug Frontend applications
10.Http/REST
Good to have Understanding of:
1.Wordpress Hooks
2.HTML, CSS, JS, Github tools, AWS, Basics of React JS.,Github link
3. Ability to create API over existing plugin data
Level of skills and experience:
5 years of hands-on experience in using Python, Spark,Sql.
Experienced in AWS Cloud usage and management.
Experience with Databricks (Lakehouse, ML, Unity Catalog, MLflow).
Experience using various ML models and frameworks such as XGBoost, Lightgbm, Torch.
Experience with orchestrators such as Airflow and Kubeflow.
Familiarity with containerization and orchestration technologies (e.g., Docker, Kubernetes).
Fundamental understanding of Parquet, Delta Lake and other data file formats.
Proficiency on an IaC tool such as Terraform, CDK or CloudFormation.
Strong written and verbal English communication skill and proficient in communication with non-technical stakeholderst
At F5, we strive to bring a better digital world to life. Our teams empower organizations across the globe to create, secure, and run applications that enhance how we experience our evolving digital world. We are passionate about cybersecurity, from protecting consumers from fraud to enabling companies to focus on innovation.
Everything we do centers around people. That means we obsess over how to make the lives of our customers, and their customers, better. And it means we prioritize a diverse F5 community where each individual can thrive.
F5, Inc. is seeking a Software Engineer III with experience in building highly available and highly scalable services on public cloud like AWS, Azure and GCP. In this role you will help develop networking and security technologies as a service (SaaS) to solve customers’ multi-cloud problem. You will be part of Cloud Orchestration team working on F5 Distributed Cloud platform.
Primary Responsibilities
-
Design and development of highly available and highly scalable services using public cloud and F5 Distributed Cloud services.
-
Understand product requirements related to multi-cloud and propose solutions.
-
Follow software development lifecycle for feature development i.e., design, develop, test and support the features
-
Creating prototypes to validate use cases and get feedback from product team and architects.
-
Work cohesively with geographically distributed team
Knowledge, Skills and Abilities
-
Experience in designing and implementing solutions for services in public cloud
-
Experience in developing software in a SaaS environment
-
Extensive hands-on experience in using Infrastructure as code (IsC) tools like terraform (preferred), cloud formation etc
-
Extensive hands-on experience in programming languages such as Golang(preferred), python, Java, Rust
-
Solid understanding of AWS VPC Networking Services like Transit Gateway, Virtual Private Gateway, Direct Connect, Gateway Load balancer, Private link etc.
-
Solid understanding of Azure Networking Services like Virtual Network (Vnet), Express route, Azure load balancers etc
-
Solid understanding of GCP networking services
-
Good understanding and experience in L2 to L7 networking protocols including but not limited to Ethernet, TCP/IP, VLAN, BGP, HTTP
-
Good understanding of container technologies such as Docker, Kubernetes etc.,
-
Working knowledge of CI/CD tools like GitLab, Argo
-
Ability to implement all phases of a development cycle for a software product from understanding requirements, going through design, development and deploy phases
-
Self-motivated and willing to delve into new areas and take on new challenges in a proactive manner
-
Excellent written and verbal communication skills.
Qualifications
-
Minimum of 5 years of related experience with a Bachelor's degree in Computer Science/related field
TeamExtn is looking for a passionate Senior Scala Engineer. It will be expected from you to build pragmatic solutions on mission-critical initiatives. If you know your stuff, see the beauty in code, have knowledge in depth and breadth, advocate best practices, and love to work with distributed systems, then this is an ideal position for you.
As a core member of our Special Projects team, you will work on various new projects in a startup-like environment. These projects may include such things as building new APIs (REST/GraphQL/gRPC) for new products, integrating new products with core Carvana services, building highly scalable back end processing systems in Scala and integrating with systems backed by Machine Learning. You will use cutting edge functional Scala libraries such as ZIO. You will have the opportunity to work closely with our Product, Experience and Software Engineering teams to deliver impact.
Responsibilities:
- Build highly scalable APIs and back end processing systems for new products
- Contribute in the full software development lifecycle from design and development to testing and operating in production
- Communicate effectively with engineers, product managers and data scientists
- Drive scalability and performance within our distributed AI platform
- Full software development lifecycle from design and development to testing and operating in production
- Communicate effectively with engineers, product managers and data scientists
Skills And Experience:
- 4+ years experience with Scala or other functional language
- Experience with Akka and Lightbend stack
- Expert with PostgreSQL, MySQL or MS SQL
- Experience in architecting, developing, deploying and operating large scale distributed systems and actor systems
- Experience with cloud APIs (e.g., GCP, AWS, Azure)
- Messaging systems such as GCP Pub/Sub, RabbitMQ, Kafka
- Strong foundation in algorithms and data structures and their real-world use cases.
- Solid understanding of computer systems and networks
- Production quality coding standards and patterns
BONUS SKILLS:
- Experience with functional programming in Scala
- Knowledge of ZIO and related ecosystem
- Experience with functional database libraries in Scala (Quill preferred)
Our Interview Process:
Our interview involves 3 steps.
1. Code Evaluation - In this step we send you a simple assignment that you implement
2. First Technical Round - In this technical round we evaulate you on your skills, concepts and knowledge in Scala.
3. Second Technical Round - If the first round goes well we check how hands you are with Scala and have online problem solving session.
Type: Individual contributor with good hands on proficiency.
Must have
- Strong proficiency in at least one of Java, Ruby, Python
- Exposure to databases: any of PostgreSQL, MySQL, Apache Cassandra
- Any NoSQL database experience is a plus
- Exposure to AWS cloud infrastructure: EC2 or S3
- Proficiency with Git
- MUST: Using REST to make API calls.
Great to have:
- Experience working with one or more middleware, enterprise bus, queueing frameworks
- Any of Memcached/Redis, Apache Kafka / RabbitMQ / PubSub+ / AmazonMQ
Soft skills:
- Appreciation for clean and well documented code
What will you do at Tradyl:
(Examples for illustration only)
- Build a shipping service module that is called by our website to query shipping rates from India to a destination country. Configure this to so that an Ops person can update shipping costs as and when they change. Own deployment and monitoring of this service.
- Use Zapier to build a workflow to export a MixPanel report into a Google sheet every day.
- Change our supplier portal (built on bubble.io) to make an API call to our customer facing site, whenever a supplier modifies his profile.
- Write an alert mechanism that identifies catalogues with insufficient information and makes them non discoverable, which can run every day.
- Work with Business Team to design a workflow for product inwarding using Airtable. Write a small app within Airtable so that whenever a product is updated as “shipped” in airtable, it updates the customer facing website.
- Use an open source dashboarding framework to create a quick dashboard to track important business events.
- 2+ years of experience with Node.js
- Expertise in Typescript, AWS, Firebase, MongoDB, and Express
You will be bringing:
- Hands-on experience in writing applications using Node.js (including Socket.io and Express or similar)
- Excellent knowledge of a few of the available databases such as MySQL, MongoDB, etc.
- Proficiency in application deployment on Linux or Ubuntu environments
- Proficiency in JavaScript languages like React and/or Angular, along with a comprehensive experience in open-source frameworks
- Experience in server-client architecture project(s)
- Ability to prioritize in a chaotic and ambiguous environment
- An open, growth mindset when giving and receiving feedback

Preferred Skills:
We want to really emphasize Spring Boot (2+ years although 1+ if candidate particularly strong) Using Redis as a caching technology with Spring Boot would be a strong plus
Using Redisson (a particular java client library that can be easily configured with Spring Boot) would be a strong plus
Knowledge of event based messaging systems (Amazon SNS, Amazon MQ, or Kafka (in AWS) Data Cleaning tools and techniques in CSV and Excel
Strong Knowledge of Spring Boot Dependency Injection and Configuration
Experience with APIs for popular e-commerce platforms (Magento, Shopify, Big Commerce, etc.)
SDLC (Software Development Lifecycle) Tools in the context of AWS. (Tools classified under DevOps)
Experience with managing AWS EC2 VM instances and using AWS managed Services (like S3, MySQL, VPC/Networking, Lambda, etc)
Performance Analysis Tools (Code Profiling) on Java VM and particularly Spring Boot
Experience in the development of Workflow or Business Process ApplicationsNice to Have:
Experience with Cassandra or MongoDB with Spring Boot
Horizontal Scaling with Spring Boot (considerations running multiple instances of Spring Boot instances)
Experience with placing Spring Boot applications in Docker/Kubernetes container ecosystems (especially in AWS)
Search technologies such as Lucene/SolrWe are looking for a talented and motivated engineer to join our fleet and help us solve real-world problems in this exciting field. Join us and share the dream of building the next generation online platform for the Auto industry.
What you'll do :
- Design and architect our core components
- End to end systems development
- Ownership of complete systems from development till production and maintenance
- Infrastructure management on AWS
Technologies you'll use :
- Microservices, AWS, Java, Spring-boot
- Nginx
- PostgreSQL, Redis
- ElasticSearch
- Gradle
- Kafka, RabbiMQ
- Any cool piece of technology that you can bring onboard.
What you are :
- You love technology and always open to learning new tools
- You are a self-starter
- You are proficient in Java, SQL
- You have good knowledge of Databases: RDBMS/Document
- You have worked with server technologies: Spring / Dropwizard / Tomcat/Spring Boot
- You have a good understanding of REST API design
- You believe in clean and maintainable code








