Informatica ETL Developer

Lightning job by Cutshort ⚡

As part of this feature, you can expect status updates about your application and replies within 72 hours (once the screening questions are answered)

About Us:

Virtualness is the first end-to-end decentralized web3 platform offering mobile-first generative AI creation, NFT minting, and marketplace tools in one place making it easy for any creator or brand to scale their business and easily capture the value-creation opportunity that blockchain presents. Built on the ethos of ’empathy at the core' Virtualness puts creators first, and is building the playbook for AI led

easy design, efficient sharing / social experiences and seamless digital commerce.

Job Description:

We are seeking a highly motivated and detail-oriented Data Analyst to join our team. The ideal candidate will possess strong analytical skills, proficiency in data manipulation and visualization tools, and a passion for deriving actionable insights from complex datasets. The Data Analyst will play a key role in interpreting data, identifying trends, and providing valuable recommendations to support strategic business objectives.

Key Responsibilities:

- Analyze large datasets to extract meaningful patterns, trends, and insights.

- Develop and maintain data models, dashboards, and reports to track key performance indicators (KPIs) and inform decision-making processes.

- Collaborate with cross-functional teams to understand business requirements and translate them into data-driven solutions.

- Perform data cleansing, transformation, and validation to ensure accuracy and consistency of data.

- Conduct ad-hoc analyses to address specific business questions and provide actionable recommendations.

- Utilize statistical techniques and predictive modeling to identify opportunities for process optimization and revenue enhancement.

- Stay updated on industry trends, best practices, and emerging technologies in data analytics and contribute to continuous improvement initiatives.

- Present findings and insights to stakeholders in a clear and compelling manner through written reports and presentations.

Qualifications:

- Bachelor's degree in Statistics, Mathematics, Computer Science, Economics, or related field; Master's degree preferred.

- Proven experience as a Data Analyst or similar role, with a track record of delivering actionable insights and driving business impact.

- Proficiency in SQL, Python, R, or other programming languages for data analysis and manipulation.

- Strong analytical skills with the ability to work with large datasets and complex data structures.

- Experience with data visualization tools such as Tableau, Power BI, or Looker.

- Familiarity with statistical techniques, machine learning algorithms, and data mining methods.

- Excellent communication and presentation skills, with the ability to convey technical concepts to non-technical stakeholders.

- Strong attention to detail and problem-solving abilities.

- Ability to work effectively both independently and as part of a team in a fast-paced environment.

Preferred Qualifications: 

- Experience with cloud-based platforms such as AWS, Google Cloud Platform, or Azure.

- Knowledge of advanced analytics techniques such as predictive modeling, clustering, and segmentation.

- Previous experience in the Web3 industry is a plus.

Benefits:

- Competitive salary

- Health insurance

- Flexible work hours

- ESOPS

- Opportunities for professional growth

- Access to cutting-edge technologies

- A collaborative and innovative work environment

Job Sector: IT, Software

Job Type: Permanent

Location: Chennai

Experience: 10 - 20 Years

Salary: 12 – 40 LPA

Education: Any Graduate

Notice Period: Immediate

Key Skills: Python, Spark, AWS, SQL, PySpark

Contact at triple eight two zero nine four two double seven

Job Description:

Requirements

• Minimum 12 years experience
• In depth understanding and knowledge on distributed computing with spark.
• Deep understanding of Spark Architecture and internals
• Proven experience in data ingestion, data integration and data analytics with spark, preferably PySpark.
• Expertise in ETL processes, data warehousing and data lakes.
• Hands on with python for Big data and analytics.
• Hands on in agile scrum model is an added advantage.
• Knowledge on CI/CD and orchestration tools is desirable.
• AWS S3, Redshift, Lambda knowledge is preferred

Title:  Data Engineer – Snowflake

Location: Mysore (Hybrid model)

Exp-2-8 yrs

Type: Full Time

Walk-in date: 25th Jan 2023 @Mysore 

Job Role: We are looking for an experienced Snowflake developer to join our team as a Data Engineer who will work as part of a team to help design and develop data-driven solutions that deliver insights to the business. The ideal candidate is a data pipeline builder and data wrangler who enjoys building data-driven systems that drive analytical solutions and building them from the ground up. You will be responsible for building and optimizing our data as well as building automated processes for production jobs. You will support our software developers, database architects, data analysts and data scientists on data initiatives

Key Roles & Responsibilities:

• Use advanced complex Snowflake/Python and SQL to extract data from source systems for ingestion into a data pipeline.
• Design, develop and deploy scalable and efficient data pipelines.
• Analyze and assemble large, complex datasets that meet functional / non-functional business requirements.
• Identify, design, and implement internal process improvements. For example: automating manual processes, optimizing data delivery, re-designing data platform infrastructure for greater scalability.
• Build required infrastructure for optimal extraction, loading, and transformation (ELT) of data from various data sources using AWS and Snowflake leveraging Python or SQL technologies.
• Monitor cloud-based systems and components for availability, performance, reliability, security and efficiency
• Create and configure appropriate cloud resources to meet the needs of the end users.
• As needed, document topology, processes, and solution architecture.
• Share your passion for staying on top of tech trends, experimenting with and learning new technologies

Qualifications & Experience

Qualification & Experience Requirements:

• Bachelor's degree in computer science, computer engineering, or a related field.
• 2-8 years of experience working with Snowflake
• 2+ years of experience with the AWS services.
• Candidate should able to write the stored procedure and function in Snowflake.
• At least 2 years’ experience in snowflake developer.
• Strong SQL Knowledge.
• Data injection in snowflake using Snowflake procedure.
• ETL Experience is Must (Could be any tool)
• Candidate should be aware of snowflake architecture.
• Worked on the Migration project
• DW Concept (Optional)
• Experience with cloud data storage and compute components including lambda functions, EC2s, containers.
• Experience with data pipeline and workflow management tools: Airflow, etc.
• Experience cleaning, testing, and evaluating data quality from a wide variety of ingestible data sources
• Experience working with Linux and UNIX environments.
• Experience with profiling data, with and without data definition documentation

• Familiar with Git
• Familiar with issue tracking systems like JIRA (Project Management Tool) or Trello.
• Experience working in an agile environment.

Desired Skills:

• Experience in Snowflake. Must be willing to be Snowflake certified in the first 3 months of employment.
• Experience with a stream-processing system: Snowpipe
• Working knowledge of AWS or Azure
• Experience in migrating from on-prem to cloud systems

We are #hiring for AWS Data Engineer expert to join our team

Job Title: AWS Data Engineer

Experience: 5 Yrs to 10Yrs

Location: Remote

Notice: Immediate or Max 20 Days

Role: Permanent Role

Skillset: AWS, ETL, SQL, Python, Pyspark, Postgres DB, Dremio.

Job Description:

 Able to develop ETL jobs.

Able to help with data curation/cleanup, data transformation, and building ETL pipelines.

Strong Postgres DB exp and knowledge of Dremio data visualization/semantic layer between DB and the application is a plus.

Sql, Python, and Pyspark is a must.

Communication should be good

 Job DescriptionPosition: Sr Data Engineer – Databricks & AWS

Experience: 4 - 5 Years

Company Profile:

Exponentia.ai is an AI tech organization with a presence across India, Singapore, the Middle East, and the UK. We are an innovative and disruptive organization, working on cutting-edge technology to help our clients transform into the enterprises of the future. We provide artificial intelligence-based products/platforms capable of automated cognitive decision-making to improve productivity, quality, and economics of the underlying business processes. Currently, we are transforming ourselves and rapidly expanding our business.

Exponentia.ai has developed long-term relationships with world-class clients such as PayPal, PayU, SBI Group, HDFC Life, Kotak Securities, Wockhardt and Adani Group amongst others.

One of the top partners of Cloudera (leading analytics player) and Qlik (leader in BI technologies), Exponentia.ai has recently been awarded the ‘Innovation Partner Award’ by Qlik in 2017.

Get to know more about us on our website: http://www.exponentia.ai/ and Life @Exponentia.

​Role Overview: 

·         A Data Engineer understands the client requirements and develops and delivers the data engineering solutions as per the scope.

·         The role requires good skills in the development of solutions using various services required for data architecture on Databricks Delta Lake, streaming, AWS, ETL Development, and data modeling.

Job Responsibilities

•         Design of data solutions on Databricks including delta lake, data warehouse, data marts and other data solutions to support the analytics needs of the organization.

•         Apply best practices during design in data modeling (logical, physical) and ETL pipelines (streaming and batch) using cloud-based services.

•         Design, develop and manage the pipelining (collection, storage, access), data engineering (data quality, ETL, Data Modelling) and understanding (documentation, exploration) of the data.

•         Interact with stakeholders regarding data landscape understanding, conducting discovery exercises, developing proof of concepts and demonstrating it to stakeholders.

Technical Skills 

•         Has more than 2 Years of experience in developing data lakes, and datamarts on the Databricks platform.

•         Proven skill sets in AWS Data Lake services such as - AWS Glue, S3, Lambda, SNS, IAM, and skills in Spark, Python, and SQL.

•         Experience in Pentaho

•         Good understanding of developing a data warehouse, data marts etc.

•         Has a good understanding of system architectures, and design patterns and should be able to design and develop applications using these principles.

Personality Traits

•         Good collaboration and communication skills

•         Excellent problem-solving skills to be able to structure the right analytical solutions.

•         Strong sense of teamwork, ownership, and accountability

•         Analytical and conceptual thinking 

•         Ability to work in a fast-paced environment with tight schedules.

•         Good presentation skills with the ability to convey complex ideas to peers and management.

Education:

BE / ME / MS/MCA.

Responsibilities:

• Be the analytical expert in Kaleidofin, managing ambiguous problems by using data to execute sophisticated quantitative modeling and deliver actionable insights.
• Develop comprehensive skills including project management, business judgment, analytical problem solving and technical depth.
• Become an expert on data and trends, both internal and external to Kaleidofin.
• Communicate key state of the business metrics and develop dashboards to enable teams to understand business metrics independently.
• Collaborate with stakeholders across teams to drive data analysis for key business questions, communicate insights and drive the planning process with company executives.
• Automate scheduling and distribution of reports and support auditing and value realization.
• Partner with enterprise architects to define and ensure proposed.
• Business Intelligence solutions adhere to an enterprise reference architecture.
• Design robust data-centric solutions and architecture that incorporates technology and strong BI solutions to scale up and eliminate repetitive tasks

Requirements:

• Experience leading development efforts through all phases of SDLC.
• 5+ years "hands-on" experience designing Analytics and Business Intelligence solutions.
• Experience with Quicksight, PowerBI, Tableau and Qlik is a plus.
• Hands on experience in SQL, data management, and scripting (preferably Python).
• Strong data visualisation design skills, data modeling and inference skills.
• Hands-on and experience in managing small teams.
• Financial services experience preferred, but not mandatory.
• Strong knowledge of architectural principles, tools, frameworks, and best practices.
• Excellent communication and presentation skills to communicate and collaborate with all levels of the organisation.
• Team handling preferred for 5+yrs experience candidates.
• Notice period less than 30 days.

Responsibilities

• Design and implement Azure BI infrastructure, ensure overall quality of delivered solution 
• Develop analytical & reporting tools, promote and drive adoption of developed BI solutions 
• Actively participate in BI community 
• Establish and enforce technical standards and documentation 
• Participate in daily scrums  
• Record progress daily in assigned Devops items 

Ideal Candidates should have

• 5 + years of experience in a similar senior business intelligence development position 
• To be successful in the role you will require a high level of expertise across all facets of the Microsoft BI stack and prior experience in designing and developing well-performing data warehouse solutions 
• Demonstrated experience using development tools such as Azure SQL database, Azure Data Factory, Azure Data Lake, Azure Synapse, and Azure DevOps. 
• Experience with development methodologies including Agile, DevOps, and CICD patterns 
• Strong oral and written communication skills in English 
• Ability and willingness to learn quickly and continuously 
• Bachelor's Degree in computer science