11+ DMS Jobs in Hyderabad | DMS Job openings in Hyderabad

AWS Glue Developer 

Work Experience: 6 to 8 Years

Work Location:  Noida, Bangalore, Chennai & Hyderabad

Must Have Skills: AWS Glue, DMS, SQL, Python, PySpark, Data integrations and Data Ops, 

Job Reference ID:BT/F21/IND

Job Description:

Design, build and configure applications to meet business process and application requirements.

Responsibilities:

7 years of work experience with ETL, Data Modelling, and Data Architecture Proficient in ETL optimization, designing, coding, and tuning big data processes using Pyspark Extensive experience to build data platforms on AWS using core AWS services Step function, EMR, Lambda, Glue and Athena, Redshift, Postgres, RDS etc and design/develop data engineering solutions. Orchestrate using Airflow.

Technical Experience:

Hands-on experience on developing Data platform and its components Data Lake, cloud Datawarehouse, APIs, Batch and streaming data pipeline Experience with building data pipelines and applications to stream and process large datasets at low latencies.

➢ Enhancements, new development, defect resolution and production support of Big data ETL development using AWS native services.

➢ Create data pipeline architecture by designing and implementing data ingestion solutions.

➢ Integrate data sets using AWS services such as Glue, Lambda functions/ Airflow.

➢ Design and optimize data models on AWS Cloud using AWS data stores such as Redshift, RDS, S3, Athena.

➢ Author ETL processes using Python, Pyspark.

➢ Build Redshift Spectrum direct transformations and data modelling using data in S3.

➢ ETL process monitoring using CloudWatch events.

➢ You will be working in collaboration with other teams. Good communication must.

➢ Must have experience in using AWS services API, AWS CLI and SDK

Professional Attributes:

➢ Experience operating very large data warehouses or data lakes Expert-level skills in writing and optimizing SQL Extensive, real-world experience designing technology components for enterprise solutions and defining solution architectures and reference architectures with a focus on cloud technology.

➢ Must have 6+ years of big data ETL experience using Python, S3, Lambda, Dynamo DB, Athena, Glue in AWS environment.

➢ Expertise in S3, RDS, Redshift, Kinesis, EC2 clusters highly desired.

Qualification:

➢ Degree in Computer Science, Computer Engineering or equivalent.

Salary: Commensurate with experience and demonstrated competence

Company Profile :

Merilytics, an Accordion company is a fast-growing analytics firm offering advanced a and intelligent analytical solutions to clients globally. We combine domain expertise, advanced analytics, and technology to provide robust solutions for clients' business problems. You can find further details about the company at https://merilytics.com.

We partner with our clients in Private Equity, CPG, Retail, Healthcare, Media & Entertainment, Technology, Logistics industries etc. by providing analytical solutions to generate superior returns. We solve clients' business problems by analyzing large amount of data to help guide their Operations, Marketing, Pricing, Customer Strategies, and much more.

Position :

- Business Associate at Merilytics will be working on complex analytical projects and is the primary owner of the work streams involved.

- The Business Associates are expected to lead the team of Business Analysts to deliver robust analytical solutions consistently and mentor the Analysts for professional development.

Location : Hyderabad

Roles and Responsibilities :

The roles and responsibilities of a Business Associate will include the below:

- Proactively provide thought leadership to the team and have complete control on the delivery process of the project.

- Understand the client's point of view and translate it into sound judgment calls in ambiguous analytical situations.

- Highlight potential analytical issues upfront and resolve them independently.

- Synthesizes the analysis and derives insights independently.

- Identify the crux of the client problem and leverage it to draw relevant actionable insights from the analysis/work.

- Ability to manage multiple Analysts and provide customized guidance for individual development.

- Resonate with our five core values - Client First, Excellence, Integrity, Respect and Teamwork.

Pre-requisites and skillsets required to apply for this role :

- Undergraduate degree (B.E/B.Tech.) from tier-1/tier-2 colleges are preferred.

- Should have 2-4 years of experience.

- Strong leadership & proactive communication to coordinate with the project team and other internal stakeholders.

- Ability to use business judgement and a structured approach towards solving complex problems.

- Experience in client-facing/professional services environment is a plus.

- Strong hard skills on analytics tools such as R, Python, SQL, and Excel is a plus.

Why Explore a Career at Merilytics :

- High growth environment: Semi-annual performance management and promotion cycles coupled with a strong meritocratic culture, enables fast track to leadership responsibility.

- Cross Domain Exposure: Interesting and challenging work streams across industries and domains that always keep you excited, motivated, and on your toes.

- Entrepreneurial Environment: Intellectual freedom to make decisions and own them. We expect you to spread your wings and assume larger responsibilities.

- Fun culture and peer group: Non-bureaucratic and fun working environment; Strong peer environment that will challenge you and accelerate your learning curve.

Other benefits for full time employees:

(i) Health and wellness programs that include employee health insurance covering immediate family members and parents, term life insurance for employees, free health camps for employees, discounted health services (including vision, dental) for employee and family members, free doctor's consultations, counselors, etc.

(ii) Corporate Meal card options for ease of use and tax benefits.

(iii) Work dinners, team lunches, company sponsored team outings and celebrations.

(iv) Reimbursement support for travel to the office, as and when promulgated by the Company.

(v) Cab reimbursement for women employees beyond a certain time of the day.

(vi) Robust leave policy to support work-life balance. Specially designed leave structure to support woman employees for maternity and related requests.

(vii) Reward and recognition platform to celebrate professional and personal milestones.

(viii) A positive & transparent work environment including various employee engagement and employee benefit initiatives to support personal and professional learning and development.

Job Description

Mandatory Requirements 

• Experience in AWS Glue

• Experience in Apache Parquet 

• Proficient in AWS S3 and data lake 

• Knowledge of Snowflake

• Understanding of file-based ingestion best practices.

• Scripting language - Python & pyspark

CORE RESPONSIBILITIES

• Create and manage cloud resources in AWS 

• Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies 

• Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform 

• Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations 

• Develop an infrastructure to collect, transform, combine and publish/distribute customer data.

• Define process improvement opportunities to optimize data collection, insights and displays.

• Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible 

• Identify and interpret trends and patterns from complex data sets 

• Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders. 

• Key participant in regular Scrum ceremonies with the agile teams  

• Proficient at developing queries, writing reports and presenting findings 

• Mentor junior members and bring best industry practices.

QUALIFICATIONS

• 5-7+ years’ experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales) 

• Strong background in math, statistics, computer science, data science or related discipline

• Advanced knowledge one of language: Java, Scala, Python, C# 

• Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake  

• Proficient with

• Data mining/programming tools (e.g. SAS, SQL, R, Python)

• Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)

• Data visualization (e.g. Tableau, Looker, MicroStrategy)

• Comfortable learning about and deploying new technologies and tools. 

• Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines. 

• Good written and oral communication skills and ability to present results to non-technical audiences 

• Knowledge of business intelligence and analytical tools, technologies and techniques.

Familiarity and experience in the following is a plus: 

• AWS certification

• Spark Streaming 

• Kafka Streaming / Kafka Connect 

• ELK Stack 

• Cassandra / MongoDB 

• CI/CD: Jenkins, GitLab, Jira, Confluence other related tools

It's regarding a permanent opening with Data Semantics

Data Semantics 

We are Product base company and Microsoft Gold Partner

Data Semantics is an award-winning Data Science company with a vision to empower every organization to harness the full potential of its data assets. In order to achieve this, we provide Artificial Intelligence, Big Data and Data Warehousing solutions to enterprises across the globe. Data Semantics was listed as one of the top 20 Analytics companies by Silicon India 2018 & CIO Review India 2014 as one of the Top 20 BI companies.  We are headquartered in Bangalore, India with our offices in 6 global locations including USA United Kingdom, Canada, United Arab Emirates (Dubai Abu Dhabi), and Mumbai. Our mission is to enable our people to learn the art of data management and visualization to help our customers make quick and smart decisions. 

Our Services include: 

Business Intelligence & Visualization

App and Data Modernization

Low Code Application Development

Artificial Intelligence

Internet of Things

Data Warehouse Modernization

Robotic Process Automation

Advanced Analytics

Our Products:

Sirius – World’s most agile conversational AI platform

Serina

Conversational Analytics

Contactless Attendance Management System

Company URL:   https://datasemantics.co 

JD:

MSBI

SSAS

SSRS

SSIS

Datawarehousing

SQL

Skills and requirements

• Experience analyzing complex and varied data in a commercial or academic setting.
• Desire to solve new and complex problems every day.
• Excellent ability to communicate scientific results to both technical and non-technical team members.

Desirable

• A degree in a numerically focused discipline such as, Maths, Physics, Chemistry, Engineering or Biological Sciences..
• Hands on experience on Python, Pyspark, SQL
• Hands on experience on building End to End Data Pipelines.
• Hands on Experience on Azure Data Factory, Azure Data Bricks, Data Lake - added advantage
• Hands on Experience in building data pipelines.
• Experience with Bigdata Tools, Hadoop, Hive, Sqoop, Spark, SparkSQL
• Experience with SQL or NoSQL databases for the purposes of data retrieval and management.
• Experience in data warehousing and business intelligence tools, techniques and technology, as well as experience in diving deep on data analysis or technical issues to come up with effective solutions.
• BS degree in math, statistics, computer science or equivalent technical field.
• Experience in data mining structured and unstructured data (SQL, ETL, data warehouse, Machine Learning etc.) in a business environment with large-scale, complex data sets.
• Proven ability to look at solutions in unconventional ways. Sees opportunities to innovate and can lead the way.
• Willing to learn and work on Data Science, ML, AI.

Bigdata with cloud:

Experience : 5-10 years

Location : Hyderabad/Chennai

Notice period : 15-20 days Max

1.  Expertise in building AWS Data Engineering pipelines with AWS Glue -> Athena -> Quick sight

2.  Experience in developing lambda functions with AWS Lambda

3.  Expertise with Spark/PySpark – Candidate should be hands on with PySpark code and should be able to do transformations with Spark

4.  Should be able to code in Python and Scala.

5.  Snowflake experience will be a plus

• Desire to explore new technology and break new ground.
• Are passionate about Open Source technology, continuous learning, and innovation.
• Have the problem-solving skills, grit, and commitment to complete challenging work assignments and meet deadlines.

Qualifications

• Engineer enterprise-class, large-scale deployments, and deliver Cloud-based Serverless solutions to our customers.
• You will work in a fast-paced environment with leading microservice and cloud technologies, and continue to develop your all-around technical skills.
• Participate in code reviews and provide meaningful feedback to other team members.
• Create technical documentation.
• Develop thorough Unit Tests to ensure code quality.

Skills and Experience

• Advanced skills in troubleshooting and tuning AWS Lambda functions developed with Java and/or Python.
• Experience with event-driven architecture design patterns and practices
• Experience in database design and architecture principles and strong SQL abilities
• Message brokers like Kafka and Kinesis
• Experience with Hadoop, Hive, and Spark (either PySpark or Scala)
• Demonstrated experience owning enterprise-class applications and delivering highly available distributed, fault-tolerant, globally accessible services at scale.
• Good understanding of distributed systems.
• Candidates will be self-motivated and display initiative, ownership, and flexibility.

Preferred Qualifications

• AWS Lambda function development experience with Java and/or Python.
• Lambda triggers such as SNS, SES, or cron.
• Databricks
• Cloud development experience with AWS services, including:
• IAM
• S3
• EC2
• AWS CLI
• API Gateway
• ECR
• CloudWatch
• Glue
• Kinesis
• DynamoDB
• Java 8 or higher
• ETL data pipeline building
• Data Lake Experience
• Python
• Docker
• MongoDB or similar NoSQL DB.
• Relational Databases (e.g., MySQL, PostgreSQL, Oracle, etc.).
• Gradle and/or Maven.
• JUnit
• Git
• Scrum
• Experience with Unix and/or macOS.
• Immediate Joiners

Nice to have:

• AWS / GCP / Azure Certification.
• Cloud development experience with Google Cloud or Azure

Required skill

• Around 6- 8.5 years of experience and around 4+ years in AI / Machine learning space
• Extensive experience in designing large scale machine learning solution for the ML use case,  large scale deployments and establishing continues automated improvement / retraining framework.
• Strong experience in Python and Java is required.
• Hands on experience on Scikit-learn, Pandas, NLTK
• Experience in Handling of Timeseries data and associated techniques like Prophet, LSTM
• Experience in Regression, Clustering, classification algorithms
• Extensive experience in buildings traditional Machine Learning SVM, XGBoost, Decision tree and Deep Neural Network models like RNN, Feedforward is required.
• Experience in AutoML like TPOT or other
• Must have strong hands on experience in Deep learning frameworks like Keras, TensorFlow or PyTorch 
• Knowledge of Capsule Network or reinforcement learning, SageMaker is a desirable skill
• Understanding of Financial domain is desirable skill

 Responsibilities 

• Design and implementation of solutions for ML Use cases
• Productionize System and Maintain those
• Lead and implement data acquisition process for ML work
• Learn new methods and model quickly and utilize those in solving use cases