11+ Data migration Jobs in Hyderabad | Data migration Job openings in Hyderabad

Technical Skills:

• Ability to understand and translate business requirements into design.
• Proficient in AWS infrastructure components such as S3, IAM, VPC, EC2, and Redshift.
• Experience in creating ETL jobs using Python/PySpark.
• Proficiency in creating AWS Lambda functions for event-based jobs.
• Knowledge of automating ETL processes using AWS Step Functions.
• Competence in building data warehouses and loading data into them.

Responsibilities:

• Understand business requirements and translate them into design.
• Assess AWS infrastructure needs for development work.
• Develop ETL jobs using Python/PySpark to meet requirements.
• Implement AWS Lambda for event-based tasks.
• Automate ETL processes using AWS Step Functions.
• Build data warehouses and manage data loading.
• Engage with customers and stakeholders to articulate the benefits of proposed solutions and frameworks.

Publicis Sapient Overview:

The Senior Associate People Senior Associate L1 in Data Engineering, you will translate client requirements into technical design, and implement components for data engineering solution. Utilize deep understanding of data integration and big data design principles in creating custom solutions or implementing package solutions. You will independently drive design discussions to insure the necessary health of the overall solution 

.

Job Summary:

As Senior Associate L1 in Data Engineering, you will do technical design, and implement components for data engineering solution. Utilize deep understanding of data integration and big data design principles in creating custom solutions or implementing package solutions. You will independently drive design discussions to insure the necessary health of the overall solution

The role requires a hands-on technologist who has strong programming background like Java / Scala / Python, should have experience in Data Ingestion, Integration and data Wrangling, Computation, Analytics pipelines and exposure to Hadoop ecosystem components. Having hands-on knowledge on at least one of AWS, GCP, Azure cloud platforms will be preferable.

Role & Responsibilities:

Job Title: Senior Associate L1 – Data Engineering

Your role is focused on Design, Development and delivery of solutions involving:

• Data Ingestion, Integration and Transformation

• Data Storage and Computation Frameworks, Performance Optimizations

• Analytics & Visualizations

• Infrastructure & Cloud Computing

• Data Management Platforms

• Build functionality for data ingestion from multiple heterogeneous sources in batch & real-time

• Build functionality for data analytics, search and aggregation

Experience Guidelines:

Mandatory Experience and Competencies:

# Competency

1.Overall 3.5+ years of IT experience with 1.5+ years in Data related technologies

2.Minimum 1.5 years of experience in Big Data technologies

3.Hands-on experience with the Hadoop stack – HDFS, sqoop, kafka, Pulsar, NiFi, Spark, Spark Streaming, Flink, Storm, hive, oozie, airflow and other components required in building end to end data pipeline. Working knowledge on real-time data pipelines is added advantage.

4.Strong experience in at least of the programming language Java, Scala, Python. Java preferable

5.Hands-on working knowledge of NoSQL and MPP data platforms like Hbase, MongoDb, Cassandra, AWS Redshift, Azure SQLDW, GCP BigQuery etc

Preferred Experience and Knowledge (Good to Have):

# Competency

1.Good knowledge of traditional ETL tools (Informatica, Talend, etc) and database technologies (Oracle, MySQL, SQL Server, Postgres) with hands on experience

2.Knowledge on data governance processes (security, lineage, catalog) and tools like Collibra, Alation etc

3.Knowledge on distributed messaging frameworks like ActiveMQ / RabbiMQ / Solace, search & indexing and Micro services architectures

4.Performance tuning and optimization of data pipelines

5.CI/CD – Infra provisioning on cloud, auto build & deployment pipelines, code quality

6.Working knowledge with data platform related services on at least 1 cloud platform, IAM and data security

7.Cloud data specialty and other related Big data technology certifications

Job Title: Senior Associate L1 – Data Engineering

Personal Attributes:

• Strong written and verbal communication skills

• Articulation skills

• Good team player

• Self-starter who requires minimal oversight

• Ability to prioritize and manage multiple tasks

• Process orientation and the ability to define and set up processes

Big data Developer

Exp: 3yrs to 7 yrs.
Job Location: Hyderabad
Notice: Immediate / within 30 days

1. Expertise in building AWS Data Engineering pipelines with AWS Glue -> Athena -> Quick sight
2. Experience in developing lambda functions with AWS Lambda
3. Expertise with Spark/PySpark Candidate should be hands on with PySpark code and should be able to do transformations with Spark
4. Should be able to code in Python and Scala.
5. Snowflake experience will be a plus

We can start keeping Hadoop and Hive requirements as good to have or understanding of is enough rather than keeping it as a desirable requirement.

Do you have a passion for computer vision and deep learning problems? We are looking for someone who thrives on collaboration and wants to push the boundaries of what is possible today! Material Depot (materialdepot.in) is on a mission to be India’s largest tech company in the Architecture, Engineering and Construction space by democratizing the construction ecosystem and bringing stakeholders onto a common digital platform. Our engineering team is responsible for developing Computer Vision and Machine Learning tools to enable digitization across the construction ecosystem. The founding team includes people from top management consulting firms and top colleges in India (like BCG, IITB), and have worked extensively in the construction space globally and is funded by top Indian VCs.

Our team empowers Architectural and Design Businesses to effectively manage their day to day operations. We are seeking an experienced, talented Data Scientist to join our team. You’ll be bringing your talents and expertise to continue building and evolving our highly available and distributed platform.

Our solutions need complex problem solving in computer vision that require robust, efficient, well tested, and clean solutions. The ideal candidate will possess the self-motivation, curiosity, and initiative to achieve those goals. Analogously, the candidate is a lifelong learner who passionately seeks to improve themselves and the quality of their work. You will work together with similar minds in a unique team where your skills and expertise can be used to influence future user experiences that will be used by millions.

• Extensive knowledge in machine learning and deep learning techniques
• Solid background in image processing/computer vision
• Experience in building datasets for computer vision tasks
• Experience working with and creating data structures / architectures
• Proficiency in at least one major machine learning framework
• Experience visualizing data to stakeholders
• Ability to analyze and debug complex algorithms
• Good understanding and applied experience in classic 2D image processing and segmentation
• Robust semantic object detection under different lighting conditions
• Segmentation of non-rigid contours in challenging/low contrast scenarios
• Sub-pixel accurate refinement of contours and features
• Experience in image quality assessment
• Experience with in depth failure analysis of algorithms
• Highly skilled in at least one scripting language such as Python or Matlab and solid experience in C++
• Creativity and curiosity for solving highly complex problems
• Excellent communication and collaboration skills
• Mentor and support other technical team members in the organization
• Create, improve, and refine workflows and processes for delivering quality software on time and with carefully calculated debt
• Work closely with product managers, customer support representatives, and account executives to help the business move fast and efficiently through relentless automation.

• You’re part of an agile, multidisciplinary team.
• You bring your own unique skill set to the table and collaborate with others to accomplish your team’s goals.
• You prioritize your work with the team and its product owner, weighing both the business and technical value of each task.
• You experiment, test, try, fail, and learn continuously.
• You don’t do things just because they were always done that way, you bring your experience and expertise with you and help the team make the best decisions.

• Strong knowledge of and experience with the functional programming paradigm.
• Experience conducting code reviews, providing feedback to other engineers.
• Great communication skills and a proven ability to work as part of a tight-knit team.

• Desire to explore new technology and break new ground.
• Are passionate about Open Source technology, continuous learning, and innovation.
• Have the problem-solving skills, grit, and commitment to complete challenging work assignments and meet deadlines.

Qualifications

• Engineer enterprise-class, large-scale deployments, and deliver Cloud-based Serverless solutions to our customers.
• You will work in a fast-paced environment with leading microservice and cloud technologies, and continue to develop your all-around technical skills.
• Participate in code reviews and provide meaningful feedback to other team members.
• Create technical documentation.
• Develop thorough Unit Tests to ensure code quality.

Skills and Experience

• Advanced skills in troubleshooting and tuning AWS Lambda functions developed with Java and/or Python.
• Experience with event-driven architecture design patterns and practices
• Experience in database design and architecture principles and strong SQL abilities
• Message brokers like Kafka and Kinesis
• Experience with Hadoop, Hive, and Spark (either PySpark or Scala)
• Demonstrated experience owning enterprise-class applications and delivering highly available distributed, fault-tolerant, globally accessible services at scale.
• Good understanding of distributed systems.
• Candidates will be self-motivated and display initiative, ownership, and flexibility.

Preferred Qualifications

• AWS Lambda function development experience with Java and/or Python.
• Lambda triggers such as SNS, SES, or cron.
• Databricks
• Cloud development experience with AWS services, including:
• IAM
• S3
• EC2
• AWS CLI
• API Gateway
• ECR
• CloudWatch
• Glue
• Kinesis
• DynamoDB
• Java 8 or higher
• ETL data pipeline building
• Data Lake Experience
• Python
• Docker
• MongoDB or similar NoSQL DB.
• Relational Databases (e.g., MySQL, PostgreSQL, Oracle, etc.).
• Gradle and/or Maven.
• JUnit
• Git
• Scrum
• Experience with Unix and/or macOS.
• Immediate Joiners

Nice to have:

• AWS / GCP / Azure Certification.
• Cloud development experience with Google Cloud or Azure

• Hands-on experience in Development
• 4-6 years of Hands on experience with Python scripts
• 2-3 years of Hands on experience in PySpark coding. Worked in spark cluster computing technology.
• 3-4 years of Hands on end to end data pipeline experience working on AWS environments
• 3-4 years of Hands on experience working on AWS services – Glue, Lambda, Step Functions, EC2, RDS, SES, SNS, DMS, CloudWatch etc.
• 2-3 years of Hands on experience working on AWS redshift
• 6+ years of Hands on experience with writing Unix Shell scripts
• Good communication skills

Required skill

• Around 6- 8.5 years of experience and around 4+ years in AI / Machine learning space
• Extensive experience in designing large scale machine learning solution for the ML use case,  large scale deployments and establishing continues automated improvement / retraining framework.
• Strong experience in Python and Java is required.
• Hands on experience on Scikit-learn, Pandas, NLTK
• Experience in Handling of Timeseries data and associated techniques like Prophet, LSTM
• Experience in Regression, Clustering, classification algorithms
• Extensive experience in buildings traditional Machine Learning SVM, XGBoost, Decision tree and Deep Neural Network models like RNN, Feedforward is required.
• Experience in AutoML like TPOT or other
• Must have strong hands on experience in Deep learning frameworks like Keras, TensorFlow or PyTorch 
• Knowledge of Capsule Network or reinforcement learning, SageMaker is a desirable skill
• Understanding of Financial domain is desirable skill

 Responsibilities 

• Design and implementation of solutions for ML Use cases
• Productionize System and Maintain those
• Lead and implement data acquisition process for ML work
• Learn new methods and model quickly and utilize those in solving use cases