We are actively seeking a Senior Data Engineer experienced in building data pipelines and integrations from 3rd party data sources by writing custom automated ETL jobs using Python. The role will work in partnership with other members of the Business Analytics team to support the development and implementation of new and existing data warehouse solutions for our clients. This includes designing database import/export processes used to generate client data warehouse deliverables.
- 2+ Years experience as an ETL developer with strong data architecture knowledge around data warehousing concepts, SQL development and optimization, and operational support models.
- Experience using Python to automate ETL/Data Processes jobs.
- Design and develop ETL and data processing solutions using data integration tools, python scripts, and AWS / Azure / On-Premise Environment.
- Experience / Willingness to learn AWS Glue / AWS Data Pipeline / Azure Data Factory for Data Integration.
- Develop and create transformation queries, views, and stored procedures for ETL processes, and process automation.
- Document data mappings, data dictionaries, processes, programs, and solutions as per established standards for data governance.
- Work with the data analytics team to assess and troubleshoot potential data quality issues at key intake points such as validating control totals at intake and then upon transformation, and transparently build lessons learned into future data quality assessments
- Solid experience with data modeling, business logic, and RESTful APIs.
- Solid experience in the Linux environment.
- Experience with NoSQL / PostgreSQL preferred
- Experience working with databases such as MySQL, NoSQL, and Postgres, and enterprise-level connectivity experience (such as connecting over TLS and through proxies).
- Experience with NGINX and SSL.
- Performance tune data processes and SQL queries, and recommend and implement data process optimization and query tuning techniques.

About NeenOpal Intelligent Solutions Private Limited
About
Company video


Connect with the team
Similar jobs
Strong Product Designer profile with B2B SaaS companies
Mandatory (Experience 1): Must have 1+ year of experience in Product Design in B2B SaaS Products
Mandatory (Experience 2): Must have end-to-end designing experience - starting from UX Research / Design to workflows, wireframing, and final UI designs
Mandatory (Skills): Must have hands-on experience with design tools like Figma, Adobe
Mandatory (Portfolio): Must have detailed case studies of Product Design works for good B2B SaaS products
Mandatory (Company): B2B SaaS product companies
Job description
Skills / Attributes Required
- Should have 6 mts - 2Yrs years of experience on Angular 13 or above
- Should have good experience on Typescript, JavaScript, HTML CSS, Microservices
- Should have good understanding of Rest API
- Should be strong in OOPS
- Should have good communication skills
- HTML based strong front-end developers for platform development
- Webservices and micro-services knowledge is must.
Job Location - Navi Mumbai -Belapur (Hybrid)
Requirements:
• New account acquisition and achievement of sales targets in the US/European market.
• Prospecting, contacting target C and D level executives, building close relationships, closing sales from remote.
• Develop deep, robust and qualified sales pipeline.
• Planning and overseeing new marketing initiatives.
• Developing quotes and proposals for clients.
• Contacting potential clients to establish rapport and arrange meetings.
Required Candidate profile:
• Good understanding of IT/Software services in Outsourced Managed IT services and cyber security. Good knowledge of selling services.
• Familiar with the trends and ability create sales opportunities.
• Proficient to work on Tenders and RFP’s.
• Bachelor’s degree in business, marketing, or related field.
• Excellent organizational skills.
• Strong communication skills and IT fluency. • Experience in sales, marketing, or related field
Job Summary
As a Data Science Lead, you will manage multiple consulting projects of varying complexity and ensure on-time and on-budget delivery for clients. You will lead a team of data scientists and collaborate across cross-functional groups, while contributing to new business development, supporting strategic business decisions and maintaining & strengthening client base
- Work with team to define business requirements, come up with analytical solution and deliver the solution with specific focus on Big Picture to drive robustness of the solution
- Work with teams of smart collaborators. Be responsible for their appraisals and career development.
- Participate and lead executive presentations with client leadership stakeholders.
- Be part of an inclusive and open environment. A culture where making mistakes and learning from them is part of life
- See how your work contributes to building an organization and be able to drive Org level initiatives that will challenge and grow your capabilities.
Role & Responsibilities
- Serve as expert in Data Science, build framework to develop Production level DS/AI models.
- Apply AI research and ML models to accelerate business innovation and solve impactful business problems for our clients.
- Lead multiple teams across clients ensuring quality and timely outcomes on all projects.
- Lead and manage the onsite-offshore relation, at the same time adding value to the client.
- Partner with business and technical stakeholders to translate challenging business problems into state-of-the-art data science solutions.
- Build a winning team focused on client success. Help team members build lasting career in data science and create a constant learning/development environment.
- Present results, insights, and recommendations to senior management with an emphasis on the business impact.
- Build engaging rapport with client leadership through relevant conversations and genuine business recommendations that impact the growth and profitability of the organization.
- Lead or contribute to org level initiatives to build the Tredence of tomorrow.
Qualification & Experience
- Bachelor's /Master's /PhD degree in a quantitative field (CS, Machine learning, Mathematics, Statistics, Data Science) or equivalent experience.
- 6-10+ years of experience in data science, building hands-on ML models
- Expertise in ML – Regression, Classification, Clustering, Time Series Modeling, Graph Network, Recommender System, Bayesian modeling, Deep learning, Computer Vision, NLP/NLU, Reinforcement learning, Federated Learning, Meta Learning.
- Proficient in some or all of the following techniques: Linear & Logistic Regression, Decision Trees, Random Forests, K-Nearest Neighbors, Support Vector Machines ANOVA , Principal Component Analysis, Gradient Boosted Trees, ANN, CNN, RNN, Transformers.
- Knowledge of programming languages SQL, Python/ R, Spark.
- Expertise in ML frameworks and libraries (TensorFlow, Keras, PyTorch).
- Experience with cloud computing services (AWS, GCP or Azure)
- Expert in Statistical Modelling & Algorithms E.g. Hypothesis testing, Sample size estimation, A/B testing
- Knowledge in Mathematical programming – Linear Programming, Mixed Integer Programming etc , Stochastic Modelling – Markov chains, Monte Carlo, Stochastic Simulation, Queuing Models.
- Experience with Optimization Solvers (Gurobi, Cplex) and Algebraic programming Languages(PulP)
- Knowledge in GPU code optimization, Spark MLlib Optimization.
- Familiarity to deploy and monitor ML models in production, delivering data products to end-users.
- Experience with ML CI/CD pipelines.
We (the Software Engineer team) are looking for a motivated, experienced person with a data-driven approach to join our Distribution Team in Bangalore to help design, execute and improve our test sets and infrastructure for producing high-quality Hadoop software.
A Day in the life
You will be part of a team that makes sure our releases are predictable and deliver high value to the customer. This team is responsible for automating and maintaining our test harness, and making test results reliable and repeatable.
You will:
-
work on making our distributed software stack more resilient to high-scale endurance runs and customer simulations
-
provide valuable fixes to our product development teams to the issues you’ve found during exhaustive test runs
-
work with product and field teams to make sure our customer simulations match the expectations and can provide valuable feedback to our customers
-
work with amazing people - We are a fun & smart team, including many of the top luminaries in Hadoop and related open source communities. We frequently interact with the research community, collaborate with engineers at other top companies & host cutting edge researchers for tech talks.
-
do innovative work - Cloudera pushes the frontier of big data & distributed computing, as our track record shows. We work on high-profile open source projects, interacting daily with engineers at other exciting companies, speaking at meet-ups, etc.
-
be a part of a great culture - Transparent and open meritocracy. Everybody is always thinking of better ways to do things, and coming up with ideas that make a difference. We build our culture to be the best workplace in our careers.
You have:
-
strong knowledge in at least 1 of the following languages: Java / Python / Scala / C++ / C#
-
hands-on experience with at least 1 of the following configuration management tools: Ansible, Chef, Puppet, Salt
-
confidence with Linux environments
-
ability to identify critical weak spots in distributed software systems
-
experience in developing automated test cases and test plans
-
ability to deal with distributed systems
-
solid interpersonal skills conducive to a distributed environment
-
ability to work independently on multiple tasks
-
self-driven & motivated, with a strong work ethic and a passion for problem solving
-
innovate and automate and break the code
The right person in this role has an opportunity to make a huge impact at Cloudera and add value to our future decisions. If this position has piqued your interest and you have what we described - we invite you to apply! An adventure in data awaits.
The brand is associated with some of the major icons across categories and tie-ups with industries covering fashion, sports, and music, of course. The founders are Marketing grads, with vast experience in the consumer lifestyle products and other major brands. With their vigorous efforts toward quality and marketing, they have been able to strike a chord with major E-commerce brands and even consumers.
What you will do:
- Defining, implementing and executing regression and stress automation tests focused on embedded software and device firmware level
- Analyzing automation test results for failures, identifying issue trends, and quantifying impact
- Isolating and reporting defects effectively quantifying customer impact, and verifying fixes through regression testing and other test methodologies
- Working cross-functionally with other QA teams, Developers and Project Managers
Desired Candidate Profile
What you need to have:- BE– CS/ ECE, MS, ME, MTech
- 2+ years of QA experience, preferably on consumer hardware/software products
- Automation experience in modern scripting or compiled languages (Python, JavaScript, C, etc.)
- Knowledge of Unix and Unix shell scripting
- Ability to communicate technical concepts to a non-technical audience
- Deep understanding of SQA methodologies & practices
- Ability to solve hard problems with creative and sustainable solutions
- Experience with hardware and/or software development lifecycle processes
- Self-motivation with the ability to drive features to delivery
- Strong hands on experience in developing applications
- Strong analytical and problem-solving skills
- Excellent oral and written communication skills
- Good logical sense, strong technical skills, and the ability to learn new technologies quickly
DevOps
Engineers : Min 3 to 5 Years
Tech Leads : Min 6 to 10 Years
- Implementing & supporting CI/CD/CT pipelines at scale.
- Knowledge and experience using Chef, Puppet or Ansible automation to deploy and be able to manage Linux systems in production and CI environments.
- Extensive experience with Shell scripts (bash).
- Knowledge and practical experience of Jenkins for CI.
- Experienced in build & release management.
- Experience of deploying JVM based applications.
- Enterprise AWS deployment with sound knowledge on AWS & AWS security.
- Knowledge of encryption technologies: IPSec, SSL, SSH.
- Minimum of 2 years of experience as a Linux Systems Engineer (CentOS/Red Hat) ideally supporting a highly-available, 24x7 production environments.
- DNS providing and maintenance.
- Helpful skills: Knowledge of applications relying on Maven, Ant, Gradle, Spring Boot.
- Knowledge of app and server monitoring tools such as ELK/AppEngine.
- Excellent written, oral communication and interpersonal skills.
● Strong programming skills in designing and implementation of multi-tier applications using web-based technologies like Spring MVC andSpring Boot.
● Knowledge in Spring Core such as Dependency Injection,Annotations and XML based Configurations.
● Knowledge in Spring JDBC & Spring Hibernate ORM.
● Good experience in developing applications with RESTFul Web Services.
● Knowledge in technologies like Apache Tomcat 7.0/8.0/8.5, Nginx
● Expertise in MySQL database technology
● Proficient at designing dynamic web applications using HTML5,
CSS3, JavaScript, jQuery, AJAX, JSON with responsive web applications using Bootstrap.
● Knowledge in AngularJS, Angular 2+ practices in commonly used
modules and creating reusable Components, Pipes and Services.
● Experienced in version control tools like GIT and ticket tracking platforms like Redmine, Backlog, etc.







