

Job Title: Data Engineer
Job Summary: As a Data Engineer, you will be responsible for designing, building, and maintaining the infrastructure and tools necessary for data collection, storage, processing, and analysis. You will work closely with data scientists and analysts to ensure that data is available, accessible, and in a format that can be easily consumed for business insights.
Responsibilities:
- Design, build, and maintain data pipelines to collect, store, and process data from various sources.
- Create and manage data warehousing and data lake solutions.
- Develop and maintain data processing and data integration tools.
- Collaborate with data scientists and analysts to design and implement data models and algorithms for data analysis.
- Optimize and scale existing data infrastructure to ensure it meets the needs of the business.
- Ensure data quality and integrity across all data sources.
- Develop and implement best practices for data governance, security, and privacy.
- Monitor data pipeline performance / Errors and troubleshoot issues as needed.
- Stay up-to-date with emerging data technologies and best practices.
Requirements:
Bachelor's degree in Computer Science, Information Systems, or a related field.
Experience with ETL tools like Matillion,SSIS,Informatica
Experience with SQL and relational databases such as SQL server, MySQL, PostgreSQL, or Oracle.
Experience in writing complex SQL queries
Strong programming skills in languages such as Python, Java, or Scala.
Experience with data modeling, data warehousing, and data integration.
Strong problem-solving skills and ability to work independently.
Excellent communication and collaboration skills.
Familiarity with big data technologies such as Hadoop, Spark, or Kafka.
Familiarity with data warehouse/Data lake technologies like Snowflake or Databricks
Familiarity with cloud computing platforms such as AWS, Azure, or GCP.
Familiarity with Reporting tools
Teamwork/ growth contribution
- Helping the team in taking the Interviews and identifying right candidates
- Adhering to timelines
- Intime status communication and upfront communication of any risks
- Tech, train, share knowledge with peers.
- Good Communication skills
- Proven abilities to take initiative and be innovative
- Analytical mind with a problem-solving aptitude
Good to have :
Master's degree in Computer Science, Information Systems, or a related field.
Experience with NoSQL databases such as MongoDB or Cassandra.
Familiarity with data visualization and business intelligence tools such as Tableau or Power BI.
Knowledge of machine learning and statistical modeling techniques.
If you are passionate about data and want to work with a dynamic team of data scientists and analysts, we encourage you to apply for this position.

Similar jobs

1. Actively seeking out new sales opportunities through cold calling, networking and social media.
2. Calling 65-70 leads everyday
3. Setting up meetings with potential clients (parents)
4. Generating Trial Classes - Pitch Parents to take PlanetSpark trial Classes
5. Negotiate/close deals and handle complaints or objections
6. Follow and achieve department’s sales goals on a monthly, quarterly and yearly basis (3L revenue per month)
7. “Go the extra mile” to drive sales
About Us
One of India's leading Renewable Energy Consultants, working with large commercial and Industrial clients and helping them choose the right Renewable Energy solution for them.
Job Profile Manager / Senior Manager– Strategy & Business Development, Renewable Energy
Qualification
• MBA –from a reputed B school or comparable qualification with 3-8 years of experience either in B2B sales or Renewable Energy Consulting
Office Location: Noida
Who we’re looking for
• We’re looking for a unicorn – the best of the best.
• Someone who lives, breathes, eats, sleeps, and dreams of Renewable Energy and consultative selling process.
• Someone who has a fire in their belly for business development and can expand a region single-handedly
• Someone who will be at the front of the company and can drive sustainable financial growth by boosting sales and forging strong relationships with clients
• Someone who is charged up to contribute and take ownership
• Someone who can crush their targets - Deliver and exceed their own goals
Responsibilities Strategize in Business Models and Business Plans
• Work with higher management in formulating business strategies
• Research for new markets and know-how of the renewable industry
• Assist and strategize in new products & services
• Making business plans and financial models
Generating Enquiries and Sales Meetings
• Prepare for meetings/calls via structured research about the target client
• Having effective sales meetings/calls in order to:
• Understand the renewable energy requirement of the client
• Position the company as their preferred Renewable Energy advisor and the best choice for the client
Sales Proposals/Transaction Management
• Create presentations based on the client’s requirements
• Coordinate with the Business Partners to generate proposals
Deal Closure/Sales Conversion
• Negotiate win-win deals
• Maintain profitability index as per management guidelines
Team Management
• Develop entry-level staff into valuable salespeople
• Accountable for achieving its own as well as its team sales target
Candidate Profile
• Should have good business analytical skills
• Proficient in financial model skills
• Should have excellent skills in office tools like Excel, PowerPoint, etc.
• Should have excellent Communication Skills and be a team player
• Should be a go-getter, focused, ambitious, sales expert and driven to succeed, result orientated, hungry for growth
Perks & Benefits
• An absolute action-packed, fun, and demanding workplace lets us thrive in a team-based environment with passion, fun, pride, and teamwork as our core values.
• Other than fixed compensation, we offer attractive (equivalent to 80% of the salary) quarterly performance incentives, team outings, and an international trip for the star performers
About Team:
CaratLane's mission is to help customers express their emotions through jewellery. Consumer Experience Technology team is an enabler to deliver the exceptional Consumer Experience and WoW business features in large scale website, apps and backend systems.
What do we want:
* 5 to 8 years of experience in Java and Spring Boot working with large scale backend applications
* Expertise in PostgreSQL and any of caching databases
* Experience in developing RESTful/GraphQL APIs and microservices based applications
* Good problem solving and debugging skills.
* Exposure on event-driven, asynchronous I/O
* Good knowledge of engineering excellence: Unit Testing/TDD, Code quality, Documentation, CI&CD
* Experience in non-functional requirements (Scalability, Performance optimisation, Security)
* Experience is Linux development and AWS ecosystem tools
Responsibilities: ·
- Develop comprehensive product documentation that meets global standards.
- Work with Engineering team to create Product Technical documentation, Knowledgebase, API Documentation.
- Work with Product Management team to create Product User Guides, FAQs, Support Knowledgebase etc.
- Work with Technical & Marketing teams to create content for Technical Blogs, White Papers, Product Comparisons, Case Studies etc.
- Periodically review existing documentation and update them for Product Releases, prepare Release Notes.
- Obtain a deep understanding of products to translate complex product information into simple, polished, and engaging content.
Skills and Qualifications:
- Bachelor’s degree in relevant technical field.
- 2-8 years’ experience as an effective technical writer for products in the Cloud Computing Industry.
- Proven ability to quickly grasp complex technical concepts and create easily understandable text and pictures.
- Understanding of Cloud Concepts and experience in creating related documentation is a must.
- Superior written and verbal communication skills, with a keen eye for detail.
- Experience working with engineering to improve user experience and create visuals for technical support content.
- Experience working with video (screen capture) creation tools for user documentation.
- Understanding of REST APIs and ability to do simple checks using Postman or similar tools.
- Experience using Wordpress and other similar tools to create documentation.
Skills
CLOUD COMPUTING, Cloud Concepts, DOCUMENTATION


Introduction
http://www.synapsica.com/">Synapsica is a https://yourstory.com/2021/06/funding-alert-synapsica-healthcare-ivycap-ventures-endiya-partners/">series-A funded HealthTech startup founded by alumni from IIT Kharagpur, AIIMS New Delhi, and IIM Ahmedabad. We believe healthcare needs to be transparent and objective while being affordable. Every patient has the right to know exactly what is happening in their bodies and they don't have to rely on cryptic 2 liners given to them as a diagnosis.
Towards this aim, we are building an artificial intelligence enabled cloud based platform to analyse medical images and create v2.0 of advanced radiology reporting. We are backed by IvyCap, Endia Partners, YCombinator and other investors from India, US, and Japan. We are proud to have GE and The Spinal Kinetics as our partners. Here’s a small sample of what we’re building: https://www.youtube.com/watch?v=FR6a94Tqqls">https://www.youtube.com/watch?v=FR6a94Tqqls
Your Roles and Responsibilities
We are looking for an experienced MLOps Engineer to join our engineering team and help us create dynamic software applications for our clients. In this role, you will be a key member of a team in decision making, implementations, development and advancement of ML operations of the core AI platform.
Roles and Responsibilities:
- Work closely with a cross functional team to serve business goals and objectives.
- Develop, Implement and Manage MLOps in cloud infrastructure for data preparation,deployment, monitoring and retraining models
- Design and build application containerisation and orchestrate with Docker and Kubernetes in AWS platform.
- Build and maintain code, tools, packages in cloud
Requirements:
- At Least 2+ years of experience in Data engineering
- At Least 3+ yr experience in Python with familiarity in popular ML libraries.
- At Least 2+ years experience in model serving and pipelines
- Working knowledge of containers like kubernetes , dockers, in AWS
- Design distributed systems deployment at scale
- Hands-on experience in coding and scripting
- Ability to write effective scalable and modular code.
- Familiarity with Git workflows, CI CD and NoSQL Mongodb
- Familiarity with Airflow, DVC and MLflow is a plus

Collaborate with the CIO on application Architecture and Design of our ETL (Extract, Transform,
Load) and other aspects of Data Pipelines. Our stack is built on top of the well-known Spark
Ecosystem (e.g. Scala, Python, etc.)
Periodically evaluate architectural landscape for efficiencies in our Data Pipelines and define current
state, target state architecture and transition plans, road maps to achieve desired architectural state
Conducts/leads and implements proof of concepts to prove new technologies in support of
architecture vision and guiding principles (e.g. Flink)
Assist in the ideation and execution of architectural principles, guidelines and technology standards
that can be leveraged across the team and organization. Specially around ETL & Data Pipelines
Promotes consistency between all applications leveraging enterprise automation capabilities
Provide architectural consultation, support, mentoring, and guidance to project teams, e.g. architects,
data scientist, developers, etc.
Collaborate with the DevOps Lead on technical features
Define and manage work items using Agile methodologies (Kanban, Azure boards, etc) Leads Data
Engineering efforts (e.g. Scala Spark, PySpark, etc)
Knowledge & Experience
Experienced with Spark, Delta Lake, and Scala to work with Petabytes of data (to work with Batch
and Streaming flows)
Knowledge of a wide variety of open source technologies including but not limited to; NiFi,
Kubernetes, Docker, Hive, Oozie, YARN, Zookeeper, PostgreSQL, RabbitMQ, Elasticsearch
A strong understanding of AWS/Azure and/or technology as a service (Iaas, SaaS, PaaS)
Strong verbal and written communications skills are a must, as well as the ability to work effectively
across internal and external organizations and virtual teams
Appreciation of building high volume, low latency systems for the API flow
Core Dev skills (SOLID principles, IOC, 12-factor app, CI-CD, GIT)
Messaging, Microservice Architecture, Caching (Redis), Containerization, Performance, and Load
testing, REST APIs
Knowledge of HTML, JavaScript frameworks (preferably Angular 2+), Typescript
Appreciation of Python and C# .NET Core or Java Appreciation of global data privacy requirements
and cryptography
Experience in System Testing and experience of automated testing e.g. unit tests, integration tests,
mocking/stubbing
Relevant industry and other professional qualifications
Tertiary qualifications (degree level)
We are an inclusive employer and welcome applicants from all backgrounds. We pride ourselves on
our commitment to Equality and Diversity and are committed to removing barriers throughout our
hiring process.
Key Requirements
Extensive data engineering development experience (e.g., ETL), using well known stacks (e.g., Scala
Spark)
Experience in Technical Leadership positions (or looking to gain experience)
Background software engineering
The ability to write technical documentation
Solid understanding of virtualization and/or cloud computing technologies (e.g., docker, Kubernetes)
Experience in designing software solutions and enjoys UML and the odd sequence diagram
Experience operating within an Agile environment Ability to work independently and with minimum
supervision
Strong project development management skills, with the ability to successfully manage and prioritize
numerous time pressured analytical projects/work tasks simultaneously
Able to pivot quickly and make rapid decisions based on changing needs in a fast-paced environment
Works constructively with teams and acts with high integrity
Passionate team player with an inquisitive, creative mindset and ability to think outside the box.
Java
J2ee
working experience with one or more clouds
Understanding of design architecture
Experience with Traditional databases and nosql databases
Sound in Algorithms,data structures and problem solving
Good at coding and design




