Data Engineer (Snowflake + Airflow) at Agivant Technologies · Remote only · 5 - 10 years · ₹18L - ₹25L / yr · Remote only · Posted 24 Apr 2025
Python
Elastic Search
Amazon Web Services (AWS)Experience: 5-8 Years
Work Mode: Remote
Job Type: Fulltime
Mandatory Skills: Python,SQL, Snowflake, Airflow, ETL, Data Pipelines, Elastic Search, & AWS.
Role Overview:
We are looking for a talented and passionate Senior Data Engineer to join our growing data team. In this role, you will play a key part in building and scaling our data infrastructure, enabling data-driven decision-making across the organization. You will be responsible for designing, developing, and maintaining efficient and reliable data pipelines for both ELT (Extract, Load, Transform) and ETL (Extract, Transform, Load) processes.
Responsibilities:
- Design, develop, and maintain robust and scalable data pipelines for ELT and ETL processes, ensuring data accuracy, completeness, and timeliness.
- Work with stakeholders to understand data requirements and translate them into efficient data models and pipelines.
- Build and optimize data pipelines using a variety of technologies, including Elastic Search, AWS S3, Snowflake, and NFS.
- Develop and maintain data warehouse schemas and ETL/ELT processes to support business intelligence and analytics needs.
- Implement data quality checks and monitoring to ensure data integrity and identify potential issues.
- Collaborate with data scientists and analysts to ensure data accessibility and usability for various analytical purposes.
- Stay current with industry best practices, CI/CD/DevSecFinOps, Scrum and emerging technologies in data engineering.
- Contribute to the development and enhancement of our data warehouse architecture
Required Skills:
- Bachelor's degree in Computer Science, Engineering, or a related field.
- 5+ years of experience as a Data Engineer with a strong focus on ELT/ETL processes.
- At least 3+ years of exp in Snowflake data warehousing technologies.
- At least 3+ years of exp in creating and maintaining Airflow ETL pipelines.
- Minimum 3+ years of professional level experience with Python languages for data manipulation and automation.
- Working experience with Elastic Search and its application in data pipelines.
- Proficiency in SQL and experience with data modelling techniques.
- Strong understanding of cloud-based data storage solutions such as AWS S3.
- Experience working with NFS and other file storage systems.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration skills.
Shubham Vishwakarma
Full Stack Developer - Averlon
Similar jobs (10)
Position: Technical Presales Manager
Job type: Full-time/ Permanent
Total Experience: Minimum 4-5 Years
- Maintain, drive, supervise and implement robust technical standards, systems and processes
- Influence technology strategies and decisions with a high level of expertise and knowledge
- Provide direction and support to ensure compliance with relevant legislative specifications and standards
- Lead a team of staff developing products, and addressing training needs when necessary
- Coordinate the regular testing of products to address faults, and provide evaluations to improve them
- Act as a key contact with customers who have technical issues
- Experience in handling technical support Team
- handling the escalated issues and resolving them over the phone/e-mail/remote meeting.
- Addressing end clients and channel partners/system integrators/solution partners/service providers/consultants.
- Conduct product demos and training
- Should be open to work in general shift.
REQUIRED SKILLS :
- Good communication skills, both written and verbal
- Self-motivated with the ability to work under pressure and own initiative
- Problem-solving skills, analytical skills and the ability to make decisions quickly
- Organisational and team leader skills
- Knowledge of process improvement and validation
- Knowledge of regulatory standards relevant to your industry
- The ability to investigate and identify trends
- Good Knowledge of Hardware and Networking concepts
- Good Knowledge of Windows, Linux and Mac OS, Android and iOS
- Good Knowledge of Antivirus, Endpoint security, DLP, MDM, and Remote technologies.
- Should be capable to handle a team of L1 engineers.
- Prepare documents on technical knowledge.
Tele sales Representative responsibilities include:
Contacting potential or existing customers to inform them about a product or service using scripts.
Answering questions about products or the company.
Asking questions to understand customer requirements and close sales.
Job brief
We are looking for an enthusiastic Tele sales Representative to contribute in generating sales for our company. You will be responsible for closing sales deals over the phone and maintaining good customer relationships.
An effective tele sales representative must be an excellent communicator and have superior people skills. They must be comfortable presenting products or services over the phone as well as dealing with complaints and doubts.
The goal is to help the company grow by bringing in customers and developing business.
Responsibilities
Contact potential or existing customers to inform them about a product or service using scripts
Answer questions about products or the company
Ask questions to understand customer requirements and close sales
Direct prospects to the field sales team when needed
Enter and update customer information in the database
Take and process orders in an accurate manner
Handle grievances to preserve the company’s reputation
Go the “extra mile” to meet sales quota and facilitate future sales
Keep records of calls and sales and note useful information
Define the product vision and compose written specifications, ensuring functional requirements for new products and features are defined in detail
Evaluate the quality of ongoing project work efforts and ensure production proceeds according to schedule
Gather and prioritise product and customer requirements
Work closely with the Development Team to deliver winning products
Define long-term, short-term and daily work priorities to guide the efforts of the Development Team working in the Scrum approach
Support Evolution Gaming’s Marketing and Sales Departments in their efforts to ensure revenue and customer satisfaction goals are met
Ensure new products and features are evaluated for usability and performance, employing focus group testing, when necessary analyse trends in the gaming market and continuously review the competitive landscape
Java
Redis- Collaborating with the product team to understand the requirement
- Managing Design and development of the product
- Ensuring code quality, security and extensibility
- Following the agile development cycles
- Conducting performance tests and optimization of the code based on the results.
- Debugging and troubleshooting of technical issues
- Helping the support team to resolve external user issues
Desired Candidate Profile
What you need to have:- B.Tech /B.E.; M.Tech; MCA
- Strong at OOPS, Java/ J2EE, JAX-RS, JDBC, RESTful Web Services, Data Structures, Queues, Multi-Threading etc.
- MySQL and Mongo database knowledge
- Basic understanding of AWS Cloud
- Must have worked on highly scalable and available systems
- Good at adapting and understanding architecture and overall design of the system
- Exposure to design patterns is a plus
- Must have exposure to agile development
- Experience of creating and maintaining system documentation such as architecture, design, deployment plan etc.
- The candidate must have excellent technical skills and must be willing to learn
- new technologies on the go.
- Good at communication
- Good Exposure to Kafka and Redis
Java
Spring BootJob Description:
• At least 4+ years of hands-on experience on solution architecture, integration of solutions.
• Strong experience in the following domains: Java EE including (Web Services, REST,JPA), Spring, SOA, Design patterns, Unit and Integration test cases frameworks,Database (SQL & No SQL)
• Knowledge and experience with CI/CD tools and API usage in Mobile applications
• Able & willing to work hands on both solutions & development
• Able to coach / guide the junior members
Amazon Web Services (AWS)Essential Responsibilities:
In this role, you will:
-
Plan engineering strategies for Edison data platform.
-
Lead and coordinate the domain technical and business discussions relative to future architecture direction.
-
Analyze design and develop a roadmap and implementation plan based upon a current vs. future state in a cohesive architecture viewpoint.
-
Review and/or analyze and develop architectural requirements at domain level within product portfolio or team.
-
Contribute to the development of software and data delivery platforms that are service-oriented with reusable components that can be orchestrated together into different methods for different businesses.
-
Lead the research and evaluation of emerging technology, industry and market trends to assist in project development and/or operational support activities.
-
Guide and mentor team members to build solution and enable successful adoption of your services by both internal and external customers.
-
Solve complex problems that arises from customer and provide alternatives
-
Provides domain expertise to own/lead technical design reviews, investigation of technical risks and analyzes impact of technology choices and provide creative solutions
-
Apply principles of SDLC and methodologies like Lean/Agile/XP, CI, good documentation practices, refactoring and testing techniques
Qualifications/Requirements:
Basic Qualifications:
-
Bachelor’s Degree in Computer Science or in “STEM” Majors (Science, Technology, Engineering and Math)
-
A minimum of 15 years of professional experience in Software Development OR Master’s degree with 10 years of experience in Software Development OR PhD with 5 years of experience
-
GE Leadership Program Graduates will get credit towards relevant work experience, commensurate to the program they have completed
-
Technical expertise in System Software Design, Data Structures, Software Reliability
-
Experience working in Public Cloud Technologies like AWS or Azure or Google Cloud environments
-
Experience with Service Oriented architectures and microservices
-
Experience with multiple data management technologies such as Blob stores, Relational stores, no SQL stores, streaming data, graph databases, etc.
-
Expert understanding of functional and nonfunctional requirements
-
Excellent analytical, interpersonal and communication skills. A big part of this job is communicating effectively with other development, cross functional teams in a global environment
-
Ability to handle multiple competing priorities in a fast-paced environment
Desired Characteristics:
-
Experience with Healthcare data standards such as HL7 FHIR & DICOM
-
Understanding of the threading limitations of Python, multi-process architecture, Python data structures, and Python packaging
-
Strong debugging and unit testing skills using a well-known and accepted unit testing framework
-
Strong analytical and strong problem solving skills, communicates in a clear and succinct manner and effectively evaluates information / data to make decisions, anticipates obstacles and develops plans to resolve, creates actionable strategies and operational plans
-
Experience with Analytics, machine learning or Medical Imaging is a PLUS.
· Manage all social media channels (Telegram, Facebook, Instagram, LinkedIN, Twitter and YouTube) and campaigns to sustain an engaging audience experience.
· Ensure user engagement across all social media channels.
· Research and analyze social media trends, including social media and web visitor data, to improve social media presence and campaign efficacy.
· Implement social media strategies across all online platforms.
· Conduct research on blockchain, cryptocurrency and digital asset trends/insights and stay updated with latest developments/happenings.
· Experience in marketing tools like Hubspot, Zoho Marketing etc.
· Experience in digital marketing in cryptocurrency and blockchain, crypto exchange platforms, NFTs, online market research industry, ed-tech industry, digital advertising industry, e-commerce industry etc. is certainly a bonus.
· Collaborate with internal teams to design the digital content strategy with the objective of increasing brand reach, engagement with relevant stakeholders.
Job Type: Full-time
Salary: Negotiable
Location: Delhi NCR
Experience: 1-2 years
Note: By applying to this job position you will have an opportunity to work with a blockchain and cryptocurrency tech start-up.
Python
DjangoAbout the Company:
Progcap is a Fintech and AI company that pioneers alternative credit scoring for small businesses using proprietary data from non-traditional sources. We aim to fuel credit to 100 million under-banked SMEs in the emerging markets worldwide with an initial focus on India.
Progcap is Sequoia-backed Series A startup, comprising of top tier talent from finance, technology, data science and operations. The Company is the recipient of the World Bank's "SME Product Innovation of the year", 2018 award, Madrid.
What you will be doing:
- Lead and provide first level supervision to project teams and ensures successful delivery of tasks assigned to the team along with sharing of project updates & related communication with stakeholders.
- Writing and ensuring reusable, testable, and efficient code.
- Managing data across multiple databases and providing analysis to stakeholders.
- Design and implementation of low-latency, high-availability, and performant applications.
- Implementation of security and data protection (permission classes and middleware.)
- Implementation of user authentication and authorization across multiple systems, servers, and environments.
What you bring:
- Should have minimum 4 years of experience in development using Python and 1 year in leading Python based projects.
- Strong experience in Application lifecycle management – development, testing and deployment.
- Strong understanding and experience with code version control tools (git, svn, etc.)
- Expert in Python with working experience on Django, AWS, Lambda, RDS, NoSQL, Docker, Kubernetes.
- Integration of data storage solutions redis, postgresql, mysql (big query, big table, pubsub, appengine).
- Strong in data structures and algorithms
- Preferably candidates with Financial/lending Applications development experience with any Fintech Co.
Java
Follow CutshortShubham Vishwakarma
Full Stack Developer - Averlon