11+ EDX Jobs in Chennai | EDX Job openings in Chennai

Technical Skills:

• Ability to understand and translate business requirements into design.
• Proficient in AWS infrastructure components such as S3, IAM, VPC, EC2, and Redshift.
• Experience in creating ETL jobs using Python/PySpark.
• Proficiency in creating AWS Lambda functions for event-based jobs.
• Knowledge of automating ETL processes using AWS Step Functions.
• Competence in building data warehouses and loading data into them.

Responsibilities:

• Understand business requirements and translate them into design.
• Assess AWS infrastructure needs for development work.
• Develop ETL jobs using Python/PySpark to meet requirements.
• Implement AWS Lambda for event-based tasks.
• Automate ETL processes using AWS Step Functions.
• Build data warehouses and manage data loading.
• Engage with customers and stakeholders to articulate the benefits of proposed solutions and frameworks.

Greetings!!!!

We are looking for a data engineer for one of our premium clients for their Chennai and Tirunelveli location

Required Education/Experience

● Bachelor’s degree in computer Science or related field

● 5-7 years’ experience in the following:

● Snowflake, Databricks management,

● Python and AWS Lambda

● Scala and/or Java

● Data integration service, SQL and Extract Transform Load (ELT)

● Azure or AWS for development and deployment

● Jira or similar tool during SDLC

● Experience managing codebase using Code repository in Git/GitHub or Bitbucket

● Experience working with a data warehouse.

● Familiarity with structured and semi-structured data formats including JSON, Avro, ORC, Parquet, or XML

● Exposure to working in an agile work environment

Title: Platform Engineer Location: Chennai Work Mode: Hybrid (Remote and Chennai Office) Experience: 4+ years Budget: 16 - 18 LPA

Responsibilities:

• Parse data using Python, create dashboards in Tableau.
• Utilize Jenkins for Airflow pipeline creation and CI/CD maintenance.
• Migrate Datastage jobs to Snowflake, optimize performance.
• Work with HDFS, Hive, Kafka, and basic Spark.
• Develop Python scripts for data parsing, quality checks, and visualization.
• Conduct unit testing and web application testing.
• Implement Apache Airflow and handle production migration.
• Apply data warehousing techniques for data cleansing and dimension modeling.

Requirements:

• 4+ years of experience as a Platform Engineer.
• Strong Python skills, knowledge of Tableau.
• Experience with Jenkins, Snowflake, HDFS, Hive, and Kafka.
• Proficient in Unix Shell Scripting and SQL.
• Familiarity with ETL tools like DataStage and DMExpress.
• Understanding of Apache Airflow.
• Strong problem-solving and communication skills.

Note: Only candidates willing to work in Chennai and available for immediate joining will be considered. Budget for this position is 16 - 18 LPA.

• Be the analytical expert in Kaleidofin, managing ambiguous problems by using data to execute sophisticated quantitative modeling and deliver actionable insights.
• Develop comprehensive skills including project management, business judgment, analytical problem solving and technical depth.
• Become an expert on data and trends, both internal and external to Kaleidofin.
• Communicate key state of the business metrics and develop dashboards to enable teams to understand business metrics independently.
• Collaborate with stakeholders across teams to drive data analysis for key business questions, communicate insights and drive the planning process with company executives.
• Automate scheduling and distribution of reports and support auditing and value realization.
• Partner with enterprise architects to define and ensure proposed.
• Business Intelligence solutions adhere to an enterprise reference architecture.
• Design robust data-centric solutions and architecture that incorporates technology and strong BI solutions to scale up and eliminate repetitive tasks.

• Experience leading development efforts through all phases of SDLC.
• 2+ years "hands-on" experience designing Analytics and Business Intelligence solutions.
• Experience with Quicksight, PowerBI, Tableau and Qlik is a plus.
• Hands on experience in SQL, data management, and scripting (preferably Python).
• Strong data visualisation design skills, data modeling and inference skills.
• Hands-on and experience in managing small teams.
• Financial services experience preferred, but not mandatory.
• Strong knowledge of architectural principles, tools, frameworks, and best practices.
• Excellent communication and presentation skills to communicate and collaborate with all levels of the organisation.
• Preferred candidates with less than 30 days notice period.

JOB SUMMARY:  The Senior Associate supports the Data Analytics Manager by proposing relevant analytics procedures/tools, executing the analytics and also developing visualization outputs for audits, continuous monitoring/auditing and IA initiatives. The individual’s responsibilities include -

Understanding audit and/or project objectives and assisting the manager in preparing the plan and timelines.

Working with the Process/BU/IA teams for gathering requirements for continuous monitoring/auditing projects.

Working with Internal audit project teams to understand the analytics requirements for audit engagements.

Independently build pilot/prototype, determine appropriate visual tool and design the views to meet project objectives.

Proficient in data management and data mining.

Highly skilled on visualization tools like Qlik View, Qlik Sense, Power BI, Tableau, Alteryx etc.

Working with Data Analytics Manager to develop analytics program aligned to the overall audit plan.

Showcasing analytics capability to Process management teams to increase adoption of continuous monitoring.

Establishing and maintaining relationships with all key stakeholders of internal audit.

Coaching other data analysts on analytics procedures, coding and tools.

Taking a significant and active role in developing and driving Internal Audit Data Analytics quality and knowledge sharing to enhance the value provided to Internal Audit stakeholders.

Ensuring timely and accurate time tracking.

Continuously focusing on self-development by attending trainings, seminars and acquiring relevant certifications.

In this role, you will: 

As part of a team focused on the preserving the customer experience across the organization, this Analytic Consultant will be responsible for: 

• Understand business objectives and provide credible challenge to analysis requirements. 
• Verify sound analysis practices and data decisions were leveraged throughout planning and data sourcing phases. 
• Conduct in-depth research within complex data environments to identify data integrity issues and propose solutions to improve analysis accuracy. 
• Applying critical evaluation to challenge assumptions, formulate a defendable hypothesis, and ensuring high quality analysis results. 
• Ensure adherence to data management/ data governance regulations and policies. 
• Performing and testing highly complex data analytics for customer remediation. 
• Designing analysis projects flow and documentation that is structured for consistency, easy to understand, and to be offered to multiple levels of reviewers, partners, and regulatory agents demonstrating research and analysis completed. 
• Investigate and ensure data integrity from multiple sources. 
• Ensure data recommended and used is the best “source of truth”. 
• Applies knowledge of business, customers, and products to synthesize data to 'form a story' and align information to contrast/compare to industry perspective. Data involved typically very large, structured or unstructured, and from multiple sources. 
• Must have a strong attention to detail and be able to meet high quality standards consistently. 
• Other duties as assigned by manager. 
• Willing to assist on high priority work outside of regular business hours or weekend as needed. 

Essential Qualifications:  

• Around 5+ years in similar analytics roles 
• Bachelors, M.A./M.Sc. College Degree or Higher in applied mathematics, statistics, engineering, physics, accounting, finance, economics, econometrics, computer sciences, or business/social and behavioral sciences with a quantitative emphasis. 
• Preferred programming knowledge SQL/SAS  
• Knowledge of PVSI, Non-Lending, Student Loans, Small Business and Personal Lines and Loans is a plus. 
• Strong experience with data integration, database structures and data warehouses. 
• Persuasive written and verbal communication skills. 

Desired Qualifications: 

• Certifications in Data Science, or BI Reporting tools. 
• Ability to prioritize work, meet deadlines, achieve goals and work under pressure in a dynamic and complex environment – Soft Skills. 
• Detail oriented, results driven, and has the ability to navigate in a quickly changing and high demand environment while balancing multiple priorities. 
• Ability to research and report on a variety of issues using problem solving skills. 
• Ability to act with integrity and a high level of professionalism with all levels of team members and management. 
• Ability to make timely and independent judgment decisions while working in a fast-paced and results-driven environment. 
• Ability to learn the business aspects quickly, multitask and prioritize between projects. 
• Exhibits appropriate sense of urgency in managing responsibilities. 
• Ability to accurately process high volumes of work within established deadlines. 
• Available to flex schedule periodically based on business need. 
• Demonstrate strong negotiation, communication & presentation skills. 
• Demonstrates a high degree of reliability, integrity and trustworthiness. 
• Takes ownership of assignments and helps drive assignments of the team. 
• Dedicated, enthusiastic, driven and performance-oriented; possesses a strong work ethic and good team player. 
• Be proactive and get engaged in organizational initiatives.

We are looking for an outstanding Big Data Engineer with experience setting up and maintaining Data Warehouse and Data Lakes for an Organization. This role would closely collaborate with the Data Science team and assist the team build and deploy machine learning and deep learning models on big data analytics platforms.

Roles and Responsibilities:

• Develop and maintain scalable data pipelines and build out new integrations and processes required for optimal extraction, transformation, and loading of data from a wide variety of data sources using 'Big Data' technologies.
• Develop programs in Scala and Python as part of data cleaning and processing.
• Assemble large, complex data sets that meet functional / non-functional business requirements and fostering data-driven decision making across the organization.  
• Responsible to design and develop distributed, high volume, high velocity multi-threaded event processing systems.
• Implement processes and systems to validate data, monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
• Perform root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
• Provide high operational excellence guaranteeing high availability and platform stability.
• Closely collaborate with the Data Science team and assist the team build and deploy machine learning and deep learning models on big data analytics platforms.

Skills:

• Experience with Big Data pipeline, Big Data analytics, Data warehousing.
• Experience with SQL/No-SQL, schema design and dimensional data modeling.
• Strong understanding of Hadoop Architecture, HDFS ecosystem and eexperience with Big Data technology stack such as HBase, Hadoop, Hive, MapReduce.
• Experience in designing systems that process structured as well as unstructured data at large scale.
• Experience in AWS/Spark/Java/Scala/Python development.
• Should have Strong skills in PySpark (Python & SPARK). Ability to create, manage and manipulate Spark Dataframes. Expertise in Spark query tuning and performance optimization.
• Experience in developing efficient software code/frameworks for multiple use cases leveraging Python and big data technologies.
• Prior exposure to streaming data sources such as Kafka.
• Should have knowledge on Shell Scripting and Python scripting.
• High proficiency in database skills (e.g., Complex SQL), for data preparation, cleaning, and data wrangling/munging, with the ability to write advanced queries and create stored procedures.
• Experience with NoSQL databases such as Cassandra / MongoDB.
• Solid experience in all phases of Software Development Lifecycle - plan, design, develop, test, release, maintain and support, decommission.
• Experience with DevOps tools (GitHub, Travis CI, and JIRA) and methodologies (Lean, Agile, Scrum, Test Driven Development).
• Experience building and deploying applications on on-premise and cloud-based infrastructure.
• Having a good understanding of machine learning landscape and concepts. 

Qualifications and Experience:

Engineering and post graduate candidates, preferably in Computer Science, from premier institutions with proven work experience as a Big Data Engineer or a similar role for 3-5 years.

Certifications:

Good to have at least one of the Certifications listed here:

    AZ 900 - Azure Fundamentals

    DP 200, DP 201, DP 203, AZ 204 - Data Engineering

    AZ 400 - Devops Certification

• Create and maintain optimal data pipeline architecture,
• Assemble large, complex data sets that meet functional / non-functional business requirements.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies.
• Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
• Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
• Keep our data separated and secure across national boundaries through multiple data centers and AWS regions.
• Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
• Work with data and analytics experts to strive for greater functionality in our data systems.

• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
• Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
• Strong analytic skills related to working with unstructured datasets.
• Build processes supporting data transformation, data structures, metadata, dependency and workload management.
• A successful history of manipulating, processing and extracting value from large disconnected datasets.
• Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
• Strong project management and organizational skills.
• Experience supporting and working with cross-functional teams in a dynamic environment.
• We are looking for a candidate with 5+ years of experience in a Data Engineer role, who has attained a Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field. They should also have experience using the following software/tools:

• Experience with big data tools: Hadoop, Spark, Kafka, etc.
• Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
• Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
• Experience with AWS cloud services: EC2, EMR, RDS, Redshift
• Experience with stream-processing systems: Storm, Spark-Streaming, etc.
• Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.