Data Engineer
at consulting & implementation services in the area of Oil & Gas, Mining and Manufacturing Industry
- Data Engineer
Required skill set: AWS GLUE, AWS LAMBDA, AWS SNS/SQS, AWS ATHENA, SPARK, SNOWFLAKE, PYTHON
Mandatory Requirements
- Experience in AWS Glue
- Experience in Apache Parquet
- Proficient in AWS S3 and data lake
- Knowledge of Snowflake
- Understanding of file-based ingestion best practices.
- Scripting language - Python & pyspark
CORE RESPONSIBILITIES
- Create and manage cloud resources in AWS
- Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, REST HTTP API, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies
- Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform
- Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations
- Develop an infrastructure to collect, transform, combine and publish/distribute customer data.
- Define process improvement opportunities to optimize data collection, insights and displays.
- Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible
- Identify and interpret trends and patterns from complex data sets
- Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders.
- Key participant in regular Scrum ceremonies with the agile teams
- Proficient at developing queries, writing reports and presenting findings
- Mentor junior members and bring best industry practices
QUALIFICATIONS
- 5-7+ years’ experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales)
- Strong background in math, statistics, computer science, data science or related discipline
- Advanced knowledge one of language: Java, Scala, Python, C#
- Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake
- Proficient with
- Data mining/programming tools (e.g. SAS, SQL, R, Python)
- Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)
- Data visualization (e.g. Tableau, Looker, MicroStrategy)
- Comfortable learning about and deploying new technologies and tools.
- Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines.
- Good written and oral communication skills and ability to present results to non-technical audiences
- Knowledge of business intelligence and analytical tools, technologies and techniques.
Familiarity and experience in the following is a plus:
- AWS certification
- Spark Streaming
- Kafka Streaming / Kafka Connect
- ELK Stack
- Cassandra / MongoDB
- CI/CD: Jenkins, GitLab, Jira, Confluence other related tools
Similar jobs
About Us
ALT Mobility: We are a full-stack EV leasing platform offering mobility as a service (MaaS) for commercial vehicle users. We simplify financing and provide reliable technology that supports the transition of intra-city logistics to electric mobility, reducing carbon footprint and improving profitability.
Who are we looking for:
As an Accounts Manager at Alt Mobility, you will play a pivotal role in managing financial transactions, maintaining accurate records, and supporting the finance and accounting functions. We are a sustainable electric mobility Leasing Company and are looking for like-minded individuals who have prior experience in financing/lending businesses.
Location: Delhi NCR (In-Office Role)
Primary responsibilities:
- Collaborate with cross-functional teams to ensure accurate recording of financial transactions related to sales, expenses, and assets.
- Preparing quarterly financial statements for reporting to multiple stakeholders such as Investors, Lenders etc.
- Support the month-end, quarter-end and year-end closing processes and coordinate with Statutory Auditors.
- Assist in the preparation, review and finalisation of monthly budgets, cash flow forecasts and variation analysis.
- Assist in the implementation and improvement of financial processes and controls.
- Stay updated on industry trends, regulations, and best practices in accounting and finance.
- Participate in team meetings and contribute to discussions on financial strategies and business growth.
Qualifications:
- CA with minimum experience of 3 years (post qualification) or 12 years experience having a Master's or Bachelor’s degree in Accounting, Finance, or a related field.
- Proven experience as an Accounts Manager or similar role, preferably in a Non-Banking Finance Company (NBFC) directly or while working at a reputed CA Firm.
- Hands-on experience or ability to work on Zoho Software (accounting software).
Fill this Google Form: https://forms.gle/krDrTxVRVpYi56TV9
to directly connect with the hiring team
Join us in our mission to transform the future of sustainable mobility. As part of Alt Mobility, you will play a pivotal role in shaping the landscape of electric vehicles and making a positive impact on the world.
About us:
Company website: https://www.neulife.com/">https://www.neulife.com/
INNOVERTUS NUTRITION TECHNOLOGIES INDIA PVT.LTD. is the leading Indian company in the field of sports nutrition products and dietary supplements. Incorporated over a decade ago, we are pioneers in introducing the concept of sports nutrition as well as educating the mass about the need to be fit and healthy, thus facilitating and educating the mass to make a choice in investing to live a healthy lifestyle.
Our culture encourages employees to dream big, perform with excellence and build incredible products. We provide the resources, support, and the focus. You bring the passion and courage to envision limitless possibilities and we’ll build a better tomorrow with you.
Are you passionate about making a difference? Are you looking for a growth opportunity where you can apply your expertise?
On our team, you will perform as a Manufacturing Planner / Production Controller supporting manufacturing operations. This role will require you to be organized with exceptional attention to detail. You will collaborate with manufacturing, research and other key essential team members supporting manufacturing.
We are seeking a Production, Planning & Inventory control Associate (PPIC) who is responsible for accurate record keeping of a live inventory
- Manage the planning and flow of material and FGs (finished Goods) to maximize on-time deliver to customers and optimizes inventory/working capital performance.
- You will identify and resolve resource conflicts, material availability and manufacturing issues.
- You will maintain ERP system integrity to ensure the optimization of the planning, execution, and control of production schedules.
- Track shipments, transfers, PO’s, inventory levels and physical inventory counts for multiple locations. Communicating with location managers to maintain required inventory levels between the various locations.
- Manages a team of buyers, planners, inventory control. Suggest and lead continuous improvement for the department and others.
- Measures and manages the performance of materials indirect and direct support teams.
- Identify, share and implement best in class supply chain practices.
- Develops standard work, policies and procedures in collaboration with other facilities Manager, Production Control Logistics and professional supply chain resources.
- Suggest and lead continuous improvement for the department and others.
- Manage Supplier held inventory programs to improve delivery, reduce lead-times and avoid risk
- Collaborate with other departments to drive continuous improvement.
- Collaborate with other facilities and regions to optimize inventory.\
- Stock Management & Update Stock Sheet in MS Excel.
- Achieving the Production Target & resolved client issue by close interaction with Production, Planning, Purchase & Sales Department.
- Implementation of 5’S, Continuous improvement related to Cost, Quality, safety & related Processes to increase productivity.
- Coordinating with Vendors and Clients
Skills & Qualification:
- Bachelor’s degree in Business Administration, Supply Chain Management or related discipline required.
- MBA or related advanced degree preferred.
- Entrepreneurial, optimistic and can work independently with minimal supervision.
- Exemplary leadership, motivation
- Experience with ERP or comparable production software.
- Minimum 3 – 5 years’ experience within the manufacturing, distribution, and/or service industry.
Location: Mumbai
Remuneration and benefits are competitive
if interested, Share your CV
Job Location:
Head office:
INNOVERTUS NUTRITION TECHNOLOGIES INDIA PVT.LTD
1st Floor, Kagalwala House,
Plot No. 175,
Behind Metro House CST Road,
Kalina, Bandra Kurla Complex,
Santacruz East,
Mumbai, Maharashtra 400098
- Sound knowledge on PHP & object oriented programming.
- Good to have joomla knowledge .
- Comprehend the architecture and design of Joomla based development
- Should have good knowledge of joomla & MVC framework
- Strong database skills in SQL, MySQL, Postgre SQL and other RDBMS
- Comfortable with CSS, XHTML, XML, JavaScript, JQuery & Ajax
- Excellent understanding of Joomla and excellent knowledge on Components, Modules and Security.
- Analytical skills for Databases, data mining & MySQL
- Excellent PHP developer with Joomla who can work independently on complex Joomla applications, who have ability to build complex Joomla applications, user interfaces, design & implementation.
Why us?
We at Wow Labz are always striving to look for exciting problems to solve. Whether we’re creating new products or helping a small startup extend its reach, we build from our heart. We’re entrepreneurial and we love new ideas. Fun culture with a team that cares about your development and growth.
What are we looking for?
You will be a part of Wow Labz’s core development team, building new software and defining standards for our very own blockchain product. You will be involved in defining technical specifications, implementing design patterns and hands-on development. You will be writing modules that all the other developers would use, including libraries, APIs, database/ storage connections and third party integrations. Your diligence and patience to build highly-secured, scalable and high-performance solutions will be most valued.
Responsibilities:
- Understanding Rust design patterns and writing performant and maintainable code in the language
- Solving development challenges and making architectural decisions by understanding the larger picture of the project’s goals.
- Expanding your existing skill-set, and picking up on various rust dependent frameworks.
- Writing code that other developers use, including libraries, APIs and configurations.
- Building secure and high-performance networked applications.
- Paying close attention to unit-testing and security.
- Confidently communicating and collaborating with your fellow developers in a remote team environment.
Desired Skills and Experience:
- 1-2 year of core Rust development experience
- 2 or more years of software development experience
- Strong understanding of macros, traits, generics and lifetimes
- Experience with Cargo, including dependency management
- Experience with frameworks like HyperWeb, Mio, Tokio, Rocket and Actix (at least two)
- Experience using the Git Version Control System (VCS)
- Experience with CI tools like Rustfmt, Clippy or Rustfix
- Experience writing Unit Tests using Rustfmt or similar
- Exposure to performance benchmarking
- Exposure to serverless products like AWS Lambda, Azure Functions, Cloudflare Workers
- Motivated by challenging projects, and you absolutely love developing with Rust.
- Developed multi-threaded software and understand the asynchronous functionalities.
If you have:
- Experience with blockchain and/or Substrate is a plus
- Experience in Mongodb, MySQL, or Javascript is a plus
- Experience with cloud platforms like AWS/ Azure/GCP is a plus
- Software architecture and API design knowledge is a plus
Persona of the kind of people who would be a culture fit:
- Curious and aware of the latest digital and social media trends
- Extremely self-driven and able to execute in a diligent manner
- Strong relationship-building skills
- Exceptional analytical reasoning, problem-solving, and creative thinking skills
- Team player that thrives in a collaborative environment
- You can work cross-functionally and collaborative on common goals
- Fluent in English, written and spoken
- Capacity to foster a healthy, stimulating work environment that frequently harnesses teamwork
About Us:
100ms is building a Platform-as-a-Service for developers integrating video-conferencing experiences into their apps. Our SDKs enable developers to add gold standard audio-video quality conferencing with much faster shipping times.
We are a team uniquely placed to work on this problem. We have built world-record scale live video infrastructure powering billions of live video minutes in a day. We are a remote-first global team with engineers who've built video teams at Facebook and Hotstar.
Job Description
100ms Platform-as-a-Service will reduce shipping live conferencing application time to days instead of months, allowing companies to focus on their core business.
We are designing our client SDKs to bring the ease-of-use of Stripe and the quality-and-scale of zoom to video conferencing. As part of the client SDK team, your job will involve creating these SDKs.
You will:
- Drive design and implementation of 100ms's JavaScript SDKs
- Articulate complex architecture problems, drive engineering excellence and collaborate with a cross-functional team
- Speak with fellow developers - our customers - to identify and prioritize features that will help achieve our goals of gold-standard audio-video conferencing in a few lines of code
- Help scale our platform to support billions of minutes a day across thousands devices around the world
- Help maintain a first-class developer onboarding experience - including writing documentation and sample apps
- Share technical practices, build development teams, and improve workflows
- Contribute to open source as we set the standards for video conferencing
You have:
- Bachelor's degree or equivalent practical experience.
- 1-3 years of professional software development experience.
- Experience with JavaScript framework development.
- Experience in API design, performance optimization, client architecture or tools in the JavaScript space
- Knowledge of JavaScript SDK performance tools and optimization techniques
You'll be a great fit if you have:
- Experience with video conferencing, Sockets, WebRTC, WebAssembly, Webpack, Canvas
- Experience with React
- Ability to take on complex and ambiguous problems
- Ability to ship consumer facing, high quality, mobile products
- Ability to speak and write in English fluently and idiomatically
- Strong inclination to keep up-to-date with latest trends, learn new concepts, or contribute to open-source projects and would be eager to talk about ideas in internal or external forums
Why 100ms
- You'll be part of a small team at a fast-growing engineering-first startup
- You'll work with engineers across the globe with experience in video at places like Facebook and Hotstar
- You can grow as an individual contributor or as a team leader - freedom to set your own goals
- You'll work on problems at the cutting-edge of real-time video communication technology at massive scale
Develop new APIs, modify the existing API using Node.js, MongoDB, JavaScript..
Create new, modify existing web pages using React.js, JavaScript.
Support the current release, production issues with code fixes.
Work on new future releases, projects and deliver within timelines.
Setup the Servers with Node.js, MongoDB, React.js, etc. in the Linux environment.
We are looking for a full-stack Javascript developer mainly with Javascript Frameworks (React, Angular) and NodeJS skillset.
As a Frontend JS Developer, you will be required to implement a complete user interface in the form of a mobile and desktop web app, with a focus on performance.
As a NodeJS developer, you will need to focus on the development of all server-side logic, definition and maintenance of the central database, and ensuring high performance and responsiveness to requests from the front-end.
Responsibilities
-
Participate in the full development life cycle, including implementing design, coding, testing and production release
-
Your main duties will include creating modules and components in React and coupling them together into a functional app.
-
Understanding the nature of asynchronous programming and its quirks and workarounds
-
Integration of multiple data sources and databases into one system
-
Creating database schemas that represent and support business processes
-
Drive innovation through rapid prototyping and iterative development
Qualifications
-
Passionate about developing amazing user experiences
-
Strong proficiency with JavaScript (Object Oriented)
-
At least 1 year of experience working in MEAN or MERN stack - i.e. React/Angular and Nodejs
-
Deep knowledge of Frontend Application practices and commonly used modules based on extensive work experience along with Node.js applications on top of RESTful APIs
-
Experience with web frontend technologies such as HTML5, CSS3, Bootstrap
-
Proficient understanding of code versioning tools, such as Git is a plus
-
Knowledge Experience in building ionic/hybrid apps is a huge positive