
Role & Responsibilities
About the Role:
We are seeking a highly skilled Senior Data Engineer with 5-7 years of experience to join our dynamic team. The ideal candidate will have a strong background in data engineering, with expertise in data warehouse architecture, data modeling, ETL processes, and building both batch and streaming pipelines. The candidate should also possess advanced proficiency in Spark, Databricks, Kafka, Python, SQL, and Change Data Capture (CDC) methodologies.
Key responsibilities:
Design, develop, and maintain robust data warehouse solutions to support the organization's analytical and reporting needs.
Implement efficient data modeling techniques to optimize performance and scalability of data systems.
Build and manage data lakehouse infrastructure, ensuring reliability, availability, and security of data assets.
Develop and maintain ETL pipelines to ingest, transform, and load data from various sources into the data warehouse and data lakehouse.
Utilize Spark and Databricks to process large-scale datasets efficiently and in real-time.
Implement Kafka for building real-time streaming pipelines and ensure data consistency and reliability.
Design and develop batch pipelines for scheduled data processing tasks.
Collaborate with cross-functional teams to gather requirements, understand data needs, and deliver effective data solutions.
Perform data analysis and troubleshooting to identify and resolve data quality issues and performance bottlenecks.
Stay updated with the latest technologies and industry trends in data engineering and contribute to continuous improvement initiatives.

Similar jobs

Looking for an experienced Product Manager to work in abroad countries who is passionate about building products that customers love. You will join a dynamic and fast-paced environment and work with cross-functional teams to design, build and roll-out products that deliver the company’s vision and strategy.
Key Responsibilities:
Product Strategy and Vision:
- Develop and communicate a product vision and strategy aligned with the company's overall business objectives.
- Conduct market research, gather customer feedback, and analyze trends to inform the product roadmap.
- Define product goals and key performance indicators (KPIs) to track success.
Product Roadmap:
- Create and maintain a detailed product roadmap, setting priorities based on customer needs, business goals, and resource constraints.
- Balance short-term needs with long-term vision and strategic goals.
Cross-functional Collaboration:
- Work closely with engineering, design, and marketing teams to ensure successful product development and launch.
- Facilitate communication between stakeholders, ensuring everyone is aligned on product requirements, timelines, and goals.
Product Development:
- Write clear and actionable product requirements (PRDs) and user stories.
- Define features, prioritize enhancements, and manage the product backlog.
- Ensure the product development process is efficient and follows Agile or other relevant methodologies.
Customer Focus:
- Conduct user research, surveys, and interviews to understand customer pain points and gather feedback.
- Analyze data and product usage to identify opportunities for improvement or new features.
- Develop customer personas and use cases to guide product decisions.
Go-to-Market Strategy:
- Work with the marketing and sales teams to create product launch strategies, including pricing, messaging, and promotional campaigns.
- Train internal teams on product features and benefits to support successful product adoption.
Lifecycle Management:
- Oversee the product's life cycle, from ideation and design through to release, iteration, and eventual retirement.
- Monitor product performance, gather user feedback, and drive continuous improvement.
Stakeholder Management:
- Serve as the primary point of contact for product-related queries across the organization.
- Present product updates, progress, and results to senior leadership and stakeholders.


- This role will be responsible for building, reviewing, deploying and maintaining the software solutions.
- Meeting with the development team to discuss user interface ideas and applications.
- Development experience in the CHATWOOT (https://www.chatwoot.com/) and other omnichannel tools.
- Reviewing application requirements and interface designs.
- Identifying web-based user interactions.
- Developing and implementing highly responsive user interface components using react concepts.
· Proven work experience as a Ruby on Rails developer
- Developing and implementing front-end architecture to support user interface concepts.
- Monitoring and improving front-end performance.
- Documenting application changes and developing updates.
- Experience with user interface design.
- Experience with browser-based debugging and performance testing software.
· Demonstrable knowledge of front-end technologies such as JavaScript, HTML, CSS and jQuery
· Experience developing highly interactive applications
· A firm grasp of object oriented analysis and design
· Passion for writing great, simple, clean, efficient code
· Good knowledge of relational databases
· Working knowledge of NoSQL databases


Job Description
A job where you increase the depth of your expertise in computer vision.
A job where you learn and implement the SOTA papers.
A job where you write vectorized code that runs in seconds, not in minutes.
A job where models learn to see and understand the world around them.
A job where models run real-time because you optimize every byte.
A job where you keep the career promises that you made to yourself.
A job where you keep the learning promises that you made to yourself.
If this scares you, don't read.
If this excites you, we might love you.
Role
We are looking for a passionate Machine Learning Engineer to join our team.
The ideal candidate will be an enthusiastic developer with 2-5 years of experience in the field of Computer Vision and Artificial Intelligence.
If building things and writing code excite you, this is the startup you belong.
Key Technologies
Must be an expert in Python and Numpy.
Experience with Tensorflow/Keras/Pytorch is required.
Unsatiable hunger for writing beautiful code.
Knowledge of python design-patterns.
Some experience with C++ is preferred.
Knowledge working closely with version control (GIT).
Excellent communication skills and being able to work independently.
Strong problem-solving and coding skills override everything else written above.
About AIMonk
Run by IIT Kanpur alumni, AIMonk is a deep tech startup.
We build beautiful and scalable software using computer vision and deep learning.
We pride ourselves in solving problems nobody else can in the space


Looking for DOT NET Developer| Gurgaon to join a team of rockstar developers. The candidate should have a minimum of 2+ yrs. of experience in {DOT NET}.
There are multiple openings. If you're looking for career growth & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will report into IIT'ans/BITS grads with 10+ years of development experience + work with F500 companies (our customers).
Company Background - CodeVyasa is a Software Product-Engineering and Development company that helps Early-stage & Mid-Market Product companies with IT Consulting, App Development, and On-demand Tech Resources. Our Journey over the last 3 years has been nothing short of a roller-coaster. Along our way, we've won some of the most prestigious awards while driving immense value to our customers & employees. Here's the link to our website (codevyasa.com). To give you a sense of our growth rate, we've added 70+ employees in the last 6 weeks itself and expect another 125+ by the end of Q4 2024
Requirements:
- Bachelor's degree in Computer Science, Information Technology, or related field .
- Minimum of 2 years of experience as a DOT NET Developer.
- Proficiency in { SQL SERVER, JQUERY, JAVA SCRIPT} development.
- Strong knowledge of {C#,DOT NETCORE} development.
- Aptitude for learning new technologies quickly.
- Good problem-solving and analytical skills.
What We Offer:
- Glassdoor rating of 4.8, indicating high employee satisfaction.
- Free healthcare benefits.
- Strong focus on upskilling and professional development opportunities.
- Diverse and inclusive work environment.
- Competitive compensation and benefits package.
- Emphasis on maintaining a healthy work-life balance.
- Strong experience in Java programming.
- Must have experience on MicroServices using Spring boots /Jersy /Swagger / any other Microservices technology stack
- Good experience in either Spring or Hibernate
- Must have at least 1to 2 years’ experience in Web application
- Knowledge of OOP concepts, industry best practices, and design
- Good understanding of web technology/enterprise-level applications
- Good to have experience in JavaScript frameworks
- Good to have experience in Agile Methodology
- Self-motivated and a Quick Learner
- Creative ideas with a problem-solving mindset.
- Ability to consistently perform and meet deadlines
- Attention to detail and follow-through
- A good understanding of customer satisfaction
- Ability to work effectively in a team as well as in an individual environment
- Excellent written and verbal communication skills
Our client is a premier web design and software solutions company based out of Delhi, Florida and California. They are a creative, young and dynamic organisation that provides superior quality solutions like web design and development, mobile app development on various platforms, cloud apps and Ecommerce web solutions. They have clients across US, Canada, UK, and Australia, who receive market ready and saleable apps.
- Building Custom Shopify Themes and Modifying Existing Themes Depending On Requirements
- Migrating Websites from other Ecommerce Platforms to Shopify
- Extending Shopify's Functionalities Using Storefront Apis, Liquid Programming, Meta Fields, Etc
- Integrating Third-party and Platform Supported Apps in the Sites
- Working Closely with Clients to Gather Requirements, Develop and Deliver On the Same
What you need to have:
- Expert-level knowledge of Shopify Liquid templating language
- Proficiency in working with different Shopify JS APIs (storefront, AJAX Cart, Sections, etc)
- Exposure to a minimum of 3 e-commerce projects (starting with requirement gathering).
- Strong Experience in MySQL and Database Queries.
- Experience working on large projects involving 10,000+ products.
- Ability to lead the team and handle pressure and demands.
- Sound knowledge of IT concepts and the latest trends.
- Ability to work independently and multi-task in a fast-paced environment.
- Strong verbal and written communication and interpersonal skills.
- Highly organized and detail-oriented.
Responsibilities
- Produce clean, efficient code based on specifications
- Integrate software components and third-party programs
- Verify and deploy programs and systems
- Troubleshoot, debug and upgrade existing software
- Gather and evaluate user feedback
- Recommend and execute improvements
- Create technical documentation for reference and reporting
Requirements and skills
- 1-3 Years of Proven experience as a Backend Developer
- Tech Stack:
- AWS- Lambda, ECS, RDS Arora, RDS PostgreSQL, DynamoDB, S3, SQS, APIG, Cloud Front
- NodeJS
- Typescript(optional)
- Familiarity with Agile development methodologies
- Experience with software design and development in a test-driven environment
- Ability to learn new languages and technologies
- Excellent communication skills
- Resourcefulness and troubleshooting aptitude
- Attention to detail


- Architectural Design on .Net, scalable, customer required design.
- Design, develop and modify software products and/or customer applications using object oriented web development utilizing ASP.NET, C#, Angular, Typescript, HTML5, XML, SQL Server 2008-2016, MVC, SVN, Web Services, Unit testing, and SOA patterns.
- Development, testing and understanding of client requirements and mapping the features to requirements.
- Support, Mentor, Guide technical teams for understanding the design.
- Communicate externally and internally with all stakeholders.
- Work on multiple projects providing development and maintenance work.
- Collaborate with inter-departments for resources required to effectively and efficiently carry out the responsibilities.
- Develop scalable and robust applications using rich interfaces, graphical views and robust user controls.
- Minimum 2 years of experience in.NET, ASP.Net, C#, HTML5, CSS3, XML, SQL Server 2008-2016, MVC, SVN, Web Services, Unit testing, and SOA patterns.
- Passion for user experience and user-centric development.
- Comprehensive understanding and assessment of the technical requirements.
- Strong communication skills that include leading design-related conversations, ability to build and nurture good relationships and foster an environment for collaboration.
- Self-starter and passionate learner.
- Client interaction, interpersonal communication, written communication, decision making ability, client focus.
- Creative problem-solver with a strong eye for detail.
- Strong team player who is able to self-manage time and deliverable proactively.
- Experience with version and source control, preferably TFS, Git or bit-bucket.



