AWS Lambda Jobs in Ahmedabad
Mandatory Requirements
- Experience in AWS Glue
- Experience in Apache Parquet
- Proficient in AWS S3 and data lake
- Knowledge of Snowflake
- Understanding of file-based ingestion best practices.
- Scripting language - Python & pyspark
CORE RESPONSIBILITIES
- Create and manage cloud resources in AWS
- Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, REST HTTP API, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies
- Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform
- Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations
- Develop an infrastructure to collect, transform, combine and publish/distribute customer data.
- Define process improvement opportunities to optimize data collection, insights and displays.
- Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible
- Identify and interpret trends and patterns from complex data sets
- Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders.
- Key participant in regular Scrum ceremonies with the agile teams
- Proficient at developing queries, writing reports and presenting findings
- Mentor junior members and bring best industry practices
QUALIFICATIONS
- 5-7+ years’ experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales)
- Strong background in math, statistics, computer science, data science or related discipline
- Advanced knowledge one of language: Java, Scala, Python, C#
- Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake
- Proficient with
- Data mining/programming tools (e.g. SAS, SQL, R, Python)
- Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)
- Data visualization (e.g. Tableau, Looker, MicroStrategy)
- Comfortable learning about and deploying new technologies and tools.
- Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines.
- Good written and oral communication skills and ability to present results to non-technical audiences
- Knowledge of business intelligence and analytical tools, technologies and techniques.
Familiarity and experience in the following is a plus:
- AWS certification
- Spark Streaming
- Kafka Streaming / Kafka Connect
- ELK Stack
- Cassandra / MongoDB
CI/CD: Jenkins, GitLab, Jira, Confluence other related tools
Work experience as a Sr. Python Developer
- Should hold hands on experience in Python frameworks like ( Django, Flask or FastAPI )
- Should have strong Unit test and debugging skills
- Good experience of code versioning tools like Git or others
- Good knowledge about Object Relational Mapper libraries
- Knowledge of working with automation and web scraping
- Experience of working with AWS and it’s services like lambda, athena, s3
- Should be able to provide full-stack coding expertise when working on projects
- Ability to integrate databases and various data sources into a unified system
- Proper knowledge of database terminologies and operations at high scales.
- Familiarity with front-end technologies ( JS / HTML )
- Work collaboratively with design team to understand end user requirements to provide technical solutions and for the implementation of new software features
Soft Skills
- Communication skills – strong and amicable communication between groups, developers, testers, designers, and users
- Competence to write clear, optimized, necessary code
- Strong problem solving and project management skills
Lead Skills
- to solve complex technical issues, comprehend risks prior to the circumstance
- Collaboration and team-orientation
- to lead the team and should have the skills of task management, time management, and project management
Our backend (NodeJS) team is passionate about technology, and we love building scalable web and mobile solutions keeping performance in mind. We're looking for a full stack developer that has experience developing a variety of Web Apps and REST API using the NodeJS stack.
(Along with strong backend expertise, needs good understanding on frontend tech stack to give support to frontend developer)
Role + Responsibilities:
- Review PR’s and provide appropriate comments.
- Help team in debugging the issues and provide proper solution.
- Participate in architecture, design and sprint planning of the projects.
- Write reusable, testable, maintainable and scalable code with Unit Testing.
- Implementation of security and data protection throughout the project.
- Implementation on Design Patterns like TDD & BDD.
Person Specification and Qualifications:
- Fluency in written and verbal communication.
- Experience developing highly scalable services and APIs in multiple protocols.
- Knowledge of data modelling and database performance optimization in SQL & No SQL databases.
- Must have worked with PostgreSQL and MongoDB using TypeORM, Sequalize or Knex.
- Strong experience with core concepts of JS & TS.
- Experience working with Frameworks like NestJS, LoopBack, Express, and other Framework in Typescript.
- Must have worked with unit testing libraries like Jest, Mocha and Chai.
- Good knowledge of code versioning (git or bitbucket).
- Hands on experience with Docker for building micro service.
Plus, points if you're familiar with the following:
- Experience with deployment and CI/CD.
- Knowledge of GraphQL and its libraries like Apollo and Prisma.
- Knowledge of SDK integration (social media SDK like Facebook, Google, etc. and Cloud services like AWS, Azure and Google).
- Good experience with Linux commands and basic server configuration.
- Knowledge of document, key/value or other non-relational database systems such as Elastic Search, Redis, DynamoDB.
- Experience with queuing protocols.
consulting & implementation services in the area of Oil & Gas, Mining and Manufacturing Industry
- Data Engineer
Required skill set: AWS GLUE, AWS LAMBDA, AWS SNS/SQS, AWS ATHENA, SPARK, SNOWFLAKE, PYTHON
Mandatory Requirements
- Experience in AWS Glue
- Experience in Apache Parquet
- Proficient in AWS S3 and data lake
- Knowledge of Snowflake
- Understanding of file-based ingestion best practices.
- Scripting language - Python & pyspark
CORE RESPONSIBILITIES
- Create and manage cloud resources in AWS
- Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, REST HTTP API, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies
- Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform
- Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations
- Develop an infrastructure to collect, transform, combine and publish/distribute customer data.
- Define process improvement opportunities to optimize data collection, insights and displays.
- Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible
- Identify and interpret trends and patterns from complex data sets
- Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders.
- Key participant in regular Scrum ceremonies with the agile teams
- Proficient at developing queries, writing reports and presenting findings
- Mentor junior members and bring best industry practices
QUALIFICATIONS
- 5-7+ years’ experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales)
- Strong background in math, statistics, computer science, data science or related discipline
- Advanced knowledge one of language: Java, Scala, Python, C#
- Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake
- Proficient with
- Data mining/programming tools (e.g. SAS, SQL, R, Python)
- Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)
- Data visualization (e.g. Tableau, Looker, MicroStrategy)
- Comfortable learning about and deploying new technologies and tools.
- Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines.
- Good written and oral communication skills and ability to present results to non-technical audiences
- Knowledge of business intelligence and analytical tools, technologies and techniques.
Familiarity and experience in the following is a plus:
- AWS certification
- Spark Streaming
- Kafka Streaming / Kafka Connect
- ELK Stack
- Cassandra / MongoDB
- CI/CD: Jenkins, GitLab, Jira, Confluence other related tools
Data Engineer
Mandatory Requirements
- Expertise in ETL , SNowFlake
- Experience in AWS ETL using AWS Glue, AWS Lambda
- Proficient in blob storage and data lake
- Understanding of file-based ingestion best practices.
CORE RESPONSIBILITIES
- Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, REST HTTP API, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies
- Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform
- Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations
- Develop an infrastructure to collect, transform, combine and publish/distribute customer data.
- Define process improvement opportunities to optimize data collection, insights and displays.
- Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible
- Identify and interpret trends and patterns from complex data sets
- Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders.
- Key participant in regular Scrum ceremonies with the agile teams
- Proficient at developing queries, writing reports and presenting findings
- Mentor junior members and bring best industry practices
QUALIFICATIONS
- 5-7+ years’ experience as data engineer in consumer finance or manufacturing or Oil & Gas industry
- Strong background in math, statistics, computer science, data science or related discipline
- Advanced knowledge one of language Python, R, C#
- Production experience with: HDFS, YARN, Hive, Spark, Kafka, Azure, Docker / Kubernetes, SQL Server, Synapse, Snowflake,AWS
- Proficient with
- Data mining/programming tools (e.g. SAS, SQL, R, Python)
- Database technologies (e.g. MongoDB, PostgreSQL, Redshift, Snowflake. and Greenplum)
- Data visualization (e.g. Tableau, PowerBI, QlikSense)
- Comfortable learning about and deploying new technologies and tools.
- Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines.
- Good written and oral communication skills and ability to present results to non-technical audiences
- Knowledge of business intelligence and analytical tools, technologies and techniques.
Please, if you are working with any MNC then please we won't consider you.
The Development Team Lead will lead projects hands-on and will be responsible for leading developers, formed into a self-organizing team that focuses on delivering brand specific sites rapidly with high quality that generates demand. The team helps build initial versions of new sites and adds new capabilities to existing sites.
The Team Leader should have an extensive technical background in web development. The candidate should also have deep and extensive process knowledge and understands how to develop and optimize a repeatable, multi-organizational process for new site delivery. The Team Leader is able to support the team, but also support the business through direct execution of tasks, training, on boarding, and developing next practices. The Team leader coaches their team members to look for and execute solutions. They are allergic to the “it’s not my job” mentality.
Essential functions:
- Develop the team based on people management plan while demonstrating various interviewing techniques to ensure you are bringing on hardworking team members with potential to grow within the organization and even across other orgs.
- Develop and support the skills, both technical and soft skills and capabilities of the team members to ensure there is enough coverage of the key responsibilities of the team based on the business’ needs.
Actively empower and delegate responsibility and ownership to team members wherever possible
- Identify and generate plans to ensure the tools and technology the team needs are in place and meeting key requirements.
- Work closely with peers and the Chief Architect to fully understand the business process and requirements.
- Analyse and resolve technical and application problems. Assess opportunities for application and process improvement and prepare documentation of rationale to share with team members and other affected parties.
- Develop code managed infrastructure though deployment scripts such as Cloudformation, Chef, Puppet
- Write APM tests for continuous monitoring and alerting using AWS Cloud watch
- Implement new customer facing features and applications in *React JS
Develop supporting APIs using Express JS, Node JS, AWS Lambda, Kinesis, AWS SAM, GraphQL*
- Develop unit tests including use of Mocha, Jest, Chai
- Develop in Git workflow participating in code peer reviews
Implement build and deployment scripts including setting up CI/CD pipelines
- Develop to 12-factor application guidelines including developing for performance optimization and scale.
Skills and abilities:
- Experience in both architecture and implementation-level software design
- Experience in requirements capture, analysis techniques and process improvement approaches
- Experience in the Web development
- Strong process focus, with specific experience in continuous delivery and self-organizing teams
- Proficient agile project management expertise with experience in leading complex partner situations, changing scope and sophisticated technical landscapes
Scope:
- Responsible for leading full-time individual contributor employees.
- Responsible for mentoring and leading Co-op students.
Education and Experience:
- Bachelor of Science in computer science or related
- 5+ years of broad and deep working experience as a Software Developer
- 1+ years of Agile training or experience strongly preferred.
- Front-end web application development using MVC design pattern
API development
- Primary responsibility is code development, agile methodology, team environment
- Sophisticated use of JavaScript including view frameworks in multiple projects
- Proven problem solving and debugging skills
- Ability to interpret ambiguous business requirements
- Knowledge of SDLC, server less architecture, design patterns, building 12-factor applications
- Experience with agile methodologies and Git workflow
- Working Conditions/Physical Requirements
- Normal office environment
- Webcam used to support telecommuting environment
Rules & Responsibilities:
- Design, implement and maintain all AWS infrastructure and services within a managed service environment
- Should be able to work on 24 X 7 shifts for support of infrastructure.
- Design, Deploy and maintain enterprise class security, network and systems management applications within an AWS environment
- Design and implement availability, scalability, and performance plans for the AWS managed service environment
- Continual re-evaluation of existing stack and infrastructure to maintain optimal performance, availability and security
- Manage the production deployment and deployment automation
- Implement process and quality improvements through task automation
- Institute infrastructure as code, security automation and automation or routine maintenance tasks
- Experience with containerization and orchestration tools like docker, Kubernetes
- Build, Deploy and Manage Kubernetes clusters thru automation
- Create and deliver knowledge sharing presentations and documentation for support teams
- Learning on the job and explore new technologies with little supervision
- Work effectively with onsite/offshore teams
Qualifications:
- Must have Bachelor's degree in Computer Science or related field and 4+ years of experience in IT
- Experience in designing, implementing, and maintaining all AWS infrastructure and services
- Design and implement availability, scalability, and performance plans for the AWS managed service environment
- Continual re-evaluation of existing stack and infrastructure to maintain optimal performance, availability, and security
- Hands-on technical expertise in Security Architecture, automation, integration, and deployment
- Familiarity with compliance & security standards across the enterprise IT landscape
- Extensive experience with Kubernetes and AWS(IAM, Route53, SSM, S3, EFS, EBS, ELB, Lambda, CloudWatch, CloudTrail, SQS, SNS, RDS, Cloud Formation, DynamoDB)
- Solid understanding of AWS IAM Roles and Policies
- Solid Linux experience with a focus on web (Apache Tomcat/Nginx)
- Experience with automation/configuration management using Terraform\Chef\Ansible or similar.
- Understanding of protocols/technologies like Microservices, HTTP/HTTPS, SSL/TLS, LDAP, JDBC, SQL, HTML
- Experience in managing and working with the offshore teams
- Familiarity with CI/CD systems such as Jenkins, GitLab CI
- Scripting experience (Python, Bash, etc.)
- AWS, Kubernetes Certification is preferred
- Ability to work with and influence Engineering teams
Roles and Responsibilities :
- Design, Develop, test and maintain software applications with MVC architectures, Microservices and scalable cloud-native apps.
- Perform hands-on coding and provide thoughtful code reviews
- Mentor and lead team members to continuously improve the quality and productivity of deliverables
- Demonstrate ability to work within an agile team as well as collaborate with many other teams on design and implementation strategies. Follow SCRUM Agile Development methodology
- Effective Communication Skills- An ability to express your ideas to the recipient & Co-ordinate and communicate with the cross-functional team along with the client's team
- Problem Solving, Hustler - Get Stuff Done, Self-Disciplined Open-minded, User-Focused, Adaptive
- Lean Principles & Analytical Thinking
- Project planning, timelines and milestones for execution and deliverables
- Participate in the Evaluation Review of your team member
Primary Skills
- Expert in Python with experience on Django.
- Expert in server programming, you should be able to implement complex business logic.
- Good understanding of the threading limitations of Python, and multi-process architecture.
- Good understanding of fundamental design principles behind a scalable application.
- Knowledge of event-driven programming in Python.
- Experience with python packages like Numpy, pandas, flask, Pyspark, pymongo, os, logging, re, pyyaml.
- Experience with swagger io module to expose API
- Strong unit test and debugging skills.
- At least 2 years of experience in RESTful API/HTTP/JSON`
- Knowledge of AWS cloud and python Boto lib.
- Proficient understanding of code versioning tools Like Git.
- Good understanding of Linux OS.
Secondary Skills:
- AWS Kinesis
- Web Sockets
- RAbbitMQ
- AWS Cloud formation