Data Engineer ( Snowflake, Bigquery, Redshift) at Infraveo Technologies Private Limited · Remote only · 4 - 5 years · ₹9.6L - ₹12L / yr · Bootstrapped · Remote only · Posted 30 Sep 2024
Data Engineer ( Snowflake, Bigquery, Redshift)
PythonWe are seeking a Data Engineer ( Snowflake, Bigquery, Redshift) to join our team. In this role, you will be responsible for the development and maintenance of fault-tolerant pipelines, including multiple database systems.
Responsibilities:
- Collaborate with engineering teams to create REST API-based pipelines for large-scale MarTech systems, optimizing for performance and reliability.
- Develop comprehensive data quality testing procedures to ensure the integrity and accuracy of data across all pipelines.
- Build scalable dbt models and configuration files, leveraging best practices for efficient data transformation and analysis.
- Partner with lead data engineers in designing scalable data models.
- Conduct thorough debugging and root cause analysis for complex data pipeline issues, implementing effective solutions and optimizations.
- Follow and adhere to group's standards such as SLAs, code styles, and deployment processes.
- Anticipate breaking changes to implement backwards compatibility strategies regarding API schema changesAssist the team in monitoring pipeline health via observability tools and metrics.
- Participate in refactoring efforts as platform application needs evolve over time.
Requirements:
- Bachelor's degree or higher in Computer Science, Engineering, Mathematics, or a related field.
- 3+ years of professional experience with a cloud database such as Snowflake, Bigquery, Redshift.
- +1 years of professional experience with dbt (cloud or core).
- Exposure to various data processing technologies such as OLAP and OLTP and their applications in real-world scenarios.
- Exposure to work cross-functionally with other teams such as Product, Customer Success, Platform Engineering.
- Familiarity with orchestration tools such as Dagster/Airflow.
- Familiarity with ETL/ELT tools such as dltHub/Meltano/Airbyte/Fivetran and DBT.
- High intermediate to advanced SQL skills (comfort with CTEs, window functions).
- Proficiency with Python and related libraries (e.g., pandas, sqlalchemy, psycopg2) for data manipulation, analysis, and automation.
Benefits:
- Work Location: Remote
- 5 days working
You can apply directly through the link:https://zrec.in/e9578?source=CareerSite
Explore our Career Page for more such jobs : careers.infraveo.com
Shubham Vishwakarma
Full Stack Developer - Averlon
About Infraveo Technologies Private Limited
About
Company social profiles
Similar jobs (10)
Java
Amazon Web Services (AWS)We’re looking for a Java Backend Developer with strong experience in Spring Boot, AWS, and Microservices to join our growing team. If you're passionate about scalable backend systems and love working in a fast-paced environment, we want to hear from you!
What You’ll Bring:
- 4+ years of backend development experience
- Strong hands-on expertise in Core Java and Spring Boot
- Experience designing and developing Microservices architecture
- Solid working knowledge of AWS services
- Familiarity with RESTful APIs, version control (Git), and CI/CD
- Strong problem-solving and debugging skills
- Ability to work independently and in a collaborative team environment
- Immediate joiners are highly preferred
Layer Tech IT Solutions is seeking a motivated IT Business Development Executive with 1–3 years of experience. The ideal candidate will drive business growth by identifying new opportunities and building strong relationships in the IT sector.
- Identify and pursue new business opportunities
- Generate leads through online/offline channels
- Build and maintain strong client relationships
- Prepare and deliver effective sales presentations
- Meet and exceed sales targets
- Excellent communication and negotiation skills
- Knowledge of IT services and solutions is a plus
Python
Django
FlaskAmazon Web Services (AWS)JOB DESCRIPTION
DYT - Do Your Thng, is an app, where all social media users can share brands they love with their followers and earn money while doing so! We believe everyone is an influencer. Our aim is to democratise social media and allow people to be rewarded for the content they post. How does DYT help you? It accelerates your career through collaboration opportunities with top brands and gives you access to a community full of experts in the influencer space.
RESPONSIBILITIES
- Expert in Python with knowledge of Python best practices (PEP8)
- Strong knowledge of python web frameworks such as Django, Flask • Strong knowledge of building RESTful APIs using Django Rest Framework • Good Understanding of Django ORM Libraries
- Able to integrate multiple data sources and databases into one system • Strong experience on Linux
- Solid database skills in a relational database (i.e. PostgresSQL,MYSql) • Able to create database schemas that represent and support business processes • Strong unit test and debugging skills
- Proficient understanding of code versioning tools (git)
- Experience deploying on AWS is desirable
- Experience with Docker,Test Drive Development will be a plus
- Excellent interpersonal, leadership, influence and communication skills • Experience in designing scalable micro-services is desirable
QUALIFICATIONS
- 1-3 years of experience as a backend developer
- At least one product build and published
- SKILLS Contribute in all phases of the development lifecycle
- Write well designed, testable, efficient code
- Work well under pressure and meet deadlines without sacrificing quality • Work with distributed development teams
AngularJS (1.x)
Angular (2+)
React.js
NodeJS (Node.js)
MongoDBResponsibilities:
• Collaboratively work with other teams and the architect to design and develop solutions aligning with the technical vision.
• Taking ownership of programming tasks/components and ensuring timely and quality delivery.
• Strong written communication and interpersonal skills.
• Exceptional troubleshooting and problem-solving skills.
• Flexibility, prioritization and time management skills, and the ability to multi-skill & multi-task.
Core Skills:
• Broad and extensive knowledge of software development and associated technologies.
• Experience in Javascript and is relevant Frameworks (Angular V2+ or React.js)
• Experience with Nodejs and its ecosystem.
• Experience in any NoSql database(s). will be an Ideal Match.
• Understanding in building containerized applications using Docker and container orchestration technologies such as AWS etc.
• Knowledge of cloud computing is added on.
PHPAmazon Web Services (AWS)Srijan Technologies is a 18+ year-old technology services firm. For a large part of its life, Srijan has specialised in building content management systems with expertise in PHP-based open-source CMS’, specifically Drupal. In recent years Srijan has diversified into
i) Data Engineering using NodeJS and Python,
ii) Data Science -- Analytics and Machine Learning and
iii) API Management using APIGEE.
Srijan is approx 400 people. Srijan’s development offices in India are located in New Delhi, Gurugram, Goa, Bangalore and Mumbai, Delhi, Gurgaon, and Goa are the largest offices. In addition, a few developers & delivery leads are located in several countries globally -- USA (New York, Charlotte), Singapore, Philippines (Manila), Australia (Sydney, Brisbane, Melbourne), Germany (Berlin), Japan (Tokyo). In each of these countries, Srijan has a functional legal subsidiary.
Srijan works largely with enterprises or mid-large sized global firms and focuses on recurring business from these accounts, thereby bringing much-needed predictability of revenue for high-growth companies. It works with several top brands at the moment.
The firm is beginning to invest in startups and in joint research projects with top institutes. For instance, it recently partnered with IIT-Delhi to invest in an 18-month project for building a solution for ‘Honey traceability using Blockchain’.
The leadership team at Srijan has set itself an audacious goal of reaching $25 million in revenue (while maintaining healthy EBITDA margins) in FY 2020 -- doubling our revenues. This requires significant technology and delivery leadership bandwidth to be created in the firm to ensure our high-quality standards are not compromised.
Each year Srijan donates 7% of its profits to Srijan Foundation Trust a registered non-profit which runs several projects including non-formal schools (directly or via partner organizations) and Indic civilizational projects such as #SrijanTalks.
Responsibilities:-
Srijan’s team of enterprise Drupalists are helping our customers build cutting-edge web experiences, migrate to Drupal, tune and improve their Drupal implementations, and advise on all things Drupal and web architecture.
With the rapid adoption of Drupal as a web platform, and with our growing number of technical development projects supporting our clients and partners, our Technical Architects are in high demand. They consult remotely or travel on-site periodically to work with some of the most talented technologists and some of the hottest web properties on leading-edge web development projects.
Engagements vary by customer and can include anything from custom coding and mentoring of partner and client teams to application design and ongoing guidance on architecture through development and application launch.
Requirements:-
● Prior experience building, leading, and architecting Drupal applications.
- Knowledge of Drupal 8, 9 is a plus.
- Knowledge of at least 1-2 non-PHP frameworks. Perform complex Drupal development tasks including custom module development using the Drupal API system and hooks from major Drupal core systems
● Ability to guide technical discussions with both technical and non-technical audiences
● Ability to negotiate mutually agreeable outcomes with clients, partners, and Srijan stakeholders.
● Ability to perform complex Drupal development tasks including custom module development using the Drupal API system and hooks from major Drupal core systems
● Experience defining and scope a technical solution for large scale Drupal projects
● Experience working in a consulting or agency environment with direct interaction with enterprise-level clients preferred.
● Excellent ability to partner with both internal and external stakeholders.
● Strong leadership and presentation skills.
● Passion for the web, open-source development.
● Deep experience architecting web solutions.
- Understanding of HTTP Layers
- Understanding of API Modeling
- Understanding the caching layers
- Understanding of Microservice architecture.
- Understanding of the Event bus system.
● PHP, Drupal, MySQL, SQL administration, and optimization, and Unix/Linux or Windows server.
● 7+ years developing Drupal applications.
● Must be a self-starter that thrives in a fast-paced work environment.
● Knowledge of or experience with other CMS technologies and/or open-source technology is a plus.
● Long-time Drupalists, that are active contributors, are well rewarded, but we’ll also help great developers and consultants become one
● Experience providing technical support or consulting strongly preferred.
● Strong problem-solving abilities, initiative, and the ability to thrive under pressure.
● Excellent interpersonal and English communication skills.
● Bachelor's or Master's degree in Computer Science or related discipline preferred
● Understanding of Virtualisation and containerization.
● Well versed with Build, Bake, and Run process of CI/CD
● Understanding of Debugging, Performance optimization and CI/Cd tools.
● Should have a pulse of the latest technology trend.
PythonDjango
ExpressAmazon Web Services (AWS)- 2+ years of experience in Python, Django, Mongo, Express, MySQL, etc
- Have built applications capable of serving high volume with low latency in production
- Following practices of agile development with continuous integration/deployment
- Experience in deploying applications in AWS cloud
- Knowledge in building applications for Fintech/payments domain is a bonus
- Bachelor’s or Master’s degree in CS or equivalent from a reputed institution
- Self-starter, hustler, and a desire to achieve greatness is a MUST
- Immediate joining preferred
- You will have the flexibility to design the application and systems from the ground up.
- Your primary responsibility is to implement business logic in the backend and create awesome restful APIs for seamless integration with our mobile front end.
Recruiter responsibilities include:
• Designing and implementing the overall recruiting strategy
• Sourcing and attracting candidates by using databases, social media etc
• Conducting interviews and filtering candidates for open positions
Job brief:
We are looking for a Recruiter with full-cycle recruiting experience, from talent
sourcing and attracting candidates to interviewing and hiring great employees.
Responsibilities:
• Design and implement overall recruiting strategy
• Develop and update job descriptions and job specifications
• Perform job and task analysis to document job requirements and objectives
• Prepare recruitment materials and post jobs to appropriate job
board/newspapers/colleges etc
• Source and recruit candidates by using databases, social media etc
• Screen candidates resumes and job applications
• Conduct interviews using various reliable recruiting and selection tools/methods to
filter candidates within schedule
• Assess applicants’ relevant knowledge, skills, soft skills, experience and aptitudes
• Onboard new employees in order to become fully integrated
• Monitor and apply HR recruiting best practices
• Provide analytical and well documented recruiting reports to the rest of the team
• Act as a point of contact and build influential candidate relationships during the
selection process
• Promote company’s reputation as “best place to work”.
Requirement:
• Proven work experience as a Recruiter (either an in-house recruiter or a staffing
agency recruiter)
• Solid ability to conduct different types of interviews (structured, competency based, stress etc)
• Hands on experience with various selection processes (video interviewing, phone
interviewing, reference check etc)
• Ability to organize skills assessment centers (in tray activities, work samples,
psychometric and IQ/EQ tests, etc)
• Familiarity with HR databases, Applicant Tracking Systems (ATS) and Candidate
Management Systems (CMS)
• Hands-on experience with recruiting software, as well as Human Resource
Information Systems (HRIS) or Human Resource Management Systems (HRMS)
• Excellent communication and interpersonal skills
• Strong decision-making skills
• BS/MS in Human Resources Management
Python
PostgreSQL
Follow CutshortShubham Vishwakarma
Full Stack Developer - Averlon