Data Engineer
at consulting & implementation services in the area of Oil & Gas, Mining and Manufacturing Industry
- Data Engineer
Required skill set: AWS GLUE, AWS LAMBDA, AWS SNS/SQS, AWS ATHENA, SPARK, SNOWFLAKE, PYTHON
Mandatory Requirements
- Experience in AWS Glue
- Experience in Apache Parquet
- Proficient in AWS S3 and data lake
- Knowledge of Snowflake
- Understanding of file-based ingestion best practices.
- Scripting language - Python & pyspark
CORE RESPONSIBILITIES
- Create and manage cloud resources in AWS
- Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, REST HTTP API, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies
- Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform
- Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations
- Develop an infrastructure to collect, transform, combine and publish/distribute customer data.
- Define process improvement opportunities to optimize data collection, insights and displays.
- Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible
- Identify and interpret trends and patterns from complex data sets
- Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders.
- Key participant in regular Scrum ceremonies with the agile teams
- Proficient at developing queries, writing reports and presenting findings
- Mentor junior members and bring best industry practices
QUALIFICATIONS
- 5-7+ years’ experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales)
- Strong background in math, statistics, computer science, data science or related discipline
- Advanced knowledge one of language: Java, Scala, Python, C#
- Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake
- Proficient with
- Data mining/programming tools (e.g. SAS, SQL, R, Python)
- Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)
- Data visualization (e.g. Tableau, Looker, MicroStrategy)
- Comfortable learning about and deploying new technologies and tools.
- Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines.
- Good written and oral communication skills and ability to present results to non-technical audiences
- Knowledge of business intelligence and analytical tools, technologies and techniques.
Familiarity and experience in the following is a plus:
- AWS certification
- Spark Streaming
- Kafka Streaming / Kafka Connect
- ELK Stack
- Cassandra / MongoDB
- CI/CD: Jenkins, GitLab, Jira, Confluence other related tools
Similar jobs
Role: Graphic Designer - Work from Home (Bangalore Drive)
Exp: 0-2 Years
CTC: 2,40,000 | Open Position: 100+
Required skills and qualifications.
- Exceptional creativity and innovative design skills
- one or more years of experience (academic and professional) with design software, including Illustrator, InDesign, Photoshop, Dreamweaver
- Excellent communication and presentation skills
- Organizational and time-management skills for meeting deadlines in a fast-paced environment
- Desire to continue building skill set with education and training.
Last round will be on-site at Bangalore.
If interested kindly share your updated cv at 82008 316781
The ideal candidate must have experience working with enterprise mobile applications to be considered for this position.
If you are a strong architect/engineers, who are hands-on and capable of designing and developing enterprise web applications, we would love to speak to you!
Required:
Expertise in enterprise web and mobile platform development
4+ years of React Native experience
Experience in AWS
Ability to own the design from inception to deployment
Experience with Cloud / SaaS environment
Hands on experience of Android and iOS Application development
Experience in JavaScript testing frameworks such as Jest, Mocha, Chai, Enzyme
Experience in CI/CD
Expertise in Object Oriented and/or functional problem decomposition
Job Title: Business Systems Analyst – Oracle EBS and Fusion Cloud
Job Description
As Oracle BSA, you will be part of a team responsible for building and supporting the key design solutions, Interfaces, and day to day activities. You will work alongside Solution Architects and Technical team to design/build/support the existing Oracle EBS system.
Key Responsibilities
- Work in a cross functional team environment to provide functional application support for the Oracle EBS application.
- Build effective working relationships with all stakeholders. Execute against agreed-upon commitments to deliver success.
- Support data driven decision-making.
- Deploy the objects to Dev, SIT & UAT environments in the projects.
- Analyze and fix any issues coming out of testing in SIT and business Testing in UAT in the implementation projects.
- Work collaboratively with team members to design a solution that will meet business requirements and fulfill user requirements.
Experience & Skills
- Have strong functional and analytical skills on problem solving and suggest solutions.
- Working functional knowledge on Oracle Procure to Pay, Inventory and WMS modules.
- Should have ability to work independently on Project deliverables.
- 5-10 years of experience in implementation and support of procurement systems.
- Experience in end-to-end solution design in Procure to Pay and Inventory modules.
If interested, please share your updated resume at devna(dot)misra(at)revgurus(dot)com
Flux Auto builds autonomous vehicle technology for commercial and industrial applications.
Responsibilities:
- Work on Embedded Software for deployment on the self-driving vehicle.
- Investigate, develop different system design and architecture for ADAS system.
- ROS version of Firmware package for multiple sensors with different communication protocols.
- Work on Serial communication (GMSL/CAN/LIN/FlexRay/Ethernet/UDP).
- Work on Multi threading and Data preprocessing.
Requirements:
- Experience in the fields of firmware development of Camera, Radar, Lidar, inertial sensors, Micro Controllers, ISP, Serdec.
- Candidate should have a strong background in Embedded system and Communication protocols.
- Candidate should have hands-on knowledge of data structures and algorithms for Data processing, and familiar with ROS (robot operating system)
- Candidate should have hands-on knowledge on Multiple sensors, Data pre processing (Clustering, noise removal, etc.) and image preprocessing (Histogram equalization, Tone mapping, etc. )
- Candidate should have real-world experience in implementing Firmware packages for multiple sensors and communication protocols
- Candidate should have experience in programming in C++ and with robust, safety-critical, efficient code
Additional requirement: Active U.S visa.
Good to Have:
- Domain knowledge and implementation experience with multiple sensor, inertial sensors, and general Embedded System Architecture
- Real world experience with system integration and deployment
- Worked on sensor fusion and Embedded systems
- Experience with Nvidia SOCs and Drive works Architecture
Benefits:
- Health Insurance
- Employee Stock Options
- Work From Home
- Flexible work hours
- Monthly Team outings and events
- Budget for Upskilling
- Flexible vacation
Equal Opportunity Employer:
Flux Auto's employment decisions are made without regard to race, color, religion, national origin, gender, sexual orientation, age, gender identity, genetic factors, military/veteran status or other characteristics protected by law.
Vaccination Requirements:
Flux Auto is implementing new requirements for employees to be fully vaccinated from COVID-19.
Apply Now!
Drive technical leadership and guidance to both your team members and your project peers
Deliver best engineered products from all engineering aspects like designing, architecting across multiple product lines
Drive customer experience, continually raising the bar on functionality, usability and simplicity
Champion engineering and operational excellence, establishing metrics and process for regular assessment and improvement
Drive best practices and is a pro with agile methodologies/practices – SCRUM, Test Driven Development (TDD) breaking down complex requirements into simpler stories
Establish a solid project framework and development processes
Communicate and collaborate effectively with global hardware and software engineering teams.
Operate strategically and tactically. Work on strategy and help set direction while staying on top of the day to day software development
Manage headcount, deliverables, schedules across on-going projects, ensure that timelines are met in accordance with the project roadmap
Direct and provide on-going leadership for a team of individual contributors, set objectives, review performances, define growth plan and nurture.
Who should apply?
Bachelor’s/Master’s degree in engineering (computer science, Information systems)
9+ years of strong experience managing software projects right from inception to launch,seeing the full lifecycle, building enterprise systems including at least 2 years of direct people management experience
Worked on large scale Java/JSP applications with good understanding of web stack
Good understanding of nuances of distributed systems
Good understanding of relational databases (preferred-Crystal, Jasper), Worked with Iaas like AWS/GCP/Azure etc.
Worked with Message Brokers and Application Containers
Analyse, design and architect, develop and maintain software solutions across multiple projects
Direct and provide on-going leadership for a team of individual contributors, set objectives, review performances, define growth plan and nurture.
Drive best practices, and is a pro with agile methodologies/practices-SCRUM, Test Driven Development (TDD) Manage headcount, deliverables, schedules across on-going projects, ensure that resources are appropriately allocated and timelines are met in accordance with
the project roadmaps.
To get transparent and quick status update, apply on: https://rb.gy/lealon
Their services are available across the globe, with over 65% of their client base being from US, UK, and Canada. The company's primary focus is on Ayurveda and taking the ancient knowledge to anyone who wishes to bring back balance to their health and apply the tools in their everyday life.
- Meeting all communication requirements of the company
- Coordinating with and working with Video Editors, Graphic Designers, the Product Team and the Media Buying Team to develop long-term content assets
- Working with the Brand Development team to produce branding collaterals
- Building a team of copywriters internally or externally to meet the high performance requirements of the company
What you need to have:
- 3-10 years of copywriting/ marketing/ advertising experience
- Ability to create compelling marketing assets including video ads, scripts for those videos, supporting copies etc.
- Exceptional reading and writing skills; great command over the English langauage, impeccable grammar.
- Strong editorial/content background and proofreading skills
- Ability to innovate and think out of the box
- People skills - ability to work well in a team, work with designers and video editors and product experts to communicate accurately and effectively.
- Ability to work hard and long in an intense, ambitious environment
- MICA alumni applications will be preferred
- 2+ years of experience participating in the delivery of technology services.
- A proven ability to learn new applications & innovate in technology
- Strong Experience in technologies like PHP
- Demonstrable knowledge of web technologies including HTML, CSS, Javascript, AJAX etc
- Good knowledge of relational databases, version control tools and of developing web services
- Experience in common third-party APIs (Google, Facebook, Ebay etc)
- Passion for best design and coding practices and a desire to develop new bold ideas
- Experience in integrating, designing and developing solutions is desirable
2.Candidates should have good learning abilities to learn new technology and domain.
3.Should have strong conviction to work hard and build long term career.
4.Excellent Time management skills and Communication skills are required.
5.Should have aptitude,logical reasoning and problem solving capabilities.
6.Any tranining,certification holding candaidates are preferred.
7.2018,19 B-Tech/M-Tech Graduates are allowed.
8.Should be available for full time.