Data Engineer
at consulting & implementation services in the area of Oil & Gas, Mining and Manufacturing Industry
Python
MongoDB
Scala
Java- Data Engineer
Required skill set: AWS GLUE, AWS LAMBDA, AWS SNS/SQS, AWS ATHENA, SPARK, SNOWFLAKE, PYTHON
Mandatory Requirements
- Experience in AWS Glue
- Experience in Apache Parquet
- Proficient in AWS S3 and data lake
- Knowledge of Snowflake
- Understanding of file-based ingestion best practices.
- Scripting language - Python & pyspark
CORE RESPONSIBILITIES
- Create and manage cloud resources in AWS
- Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, REST HTTP API, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies
- Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform
- Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations
- Develop an infrastructure to collect, transform, combine and publish/distribute customer data.
- Define process improvement opportunities to optimize data collection, insights and displays.
- Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible
- Identify and interpret trends and patterns from complex data sets
- Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders.
- Key participant in regular Scrum ceremonies with the agile teams
- Proficient at developing queries, writing reports and presenting findings
- Mentor junior members and bring best industry practices
QUALIFICATIONS
- 5-7+ years’ experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales)
- Strong background in math, statistics, computer science, data science or related discipline
- Advanced knowledge one of language: Java, Scala, Python, C#
- Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake
- Proficient with
- Data mining/programming tools (e.g. SAS, SQL, R, Python)
- Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)
- Data visualization (e.g. Tableau, Looker, MicroStrategy)
- Comfortable learning about and deploying new technologies and tools.
- Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines.
- Good written and oral communication skills and ability to present results to non-technical audiences
- Knowledge of business intelligence and analytical tools, technologies and techniques.
Familiarity and experience in the following is a plus:
- AWS certification
- Spark Streaming
- Kafka Streaming / Kafka Connect
- ELK Stack
- Cassandra / MongoDB
- CI/CD: Jenkins, GitLab, Jira, Confluence other related tools
Shubham Vishwakarma
Full Stack Developer - Averlon
Similar jobs
Java
Spring Boot🚀 Hiring: Java Developer at Deqode
⭐ Experience: 4+ Years
📍 Location: Indore, Pune, Mumbai, Nagpur, Noida, Kolkata, Bangalore,Chennai
⭐ Work Mode:- Hybrid
⏱️ Notice Period: Immediate Joiners
(Only immediate joiners & candidates serving notice period)
Requirements
✅ Strong proficiency in Java (Java 8/11/17)
✅ Experience with Spring / Spring Boot
✅ Knowledge of REST APIs, Microservices architecture
✅ Familiarity with SQL/NoSQL databases
✅ Understanding of Git, CI/CD pipelines
✅ Problem-solving skills and attention to detail
Vue.js
AngularJS (1.x)
Angular (2+)
React.js
JavascriptWe are looking for a PHP Laravel developer to join our agile team of professionals.
Apply now for the role of a Laravel Developer at Codebuddy, which is opening doors for skilled, energetic developers looking for challenging roles.
If you are passionate about technology, constantly seeking to learn and improve your skill set, create multiple layers of applications while working cross-functionally across different infrastructures. You would fit perfectly if you love problem-solving, design, and creating quality offerings.
Responsibilities:
● Discussing project aims with the client and development team.
● Designing and building web applications using Laravel.
● Troubleshooting issues in the implementation and debug builds.
● Working with front-end and back-end developers on projects.
● Testing functionality for users and the backend.
● Ensuring that integrations run smoothly.
● Scaling projects based on client feedback.
● Recording and reporting on work done in Laravel.
● Maintaining web-based applications.
● Presenting work in meetings with clients and management.
What You Need To Apply (Technical Competency) :
● A degree in programming, computer science, or a related field.
● Minimum 1 year experience working with PHP, performing unit testing, and managing APIs such as REST.
● A solid understanding of application design using Laravel.
● Knowledge of database design and querying using SQL.
● Proficiency in HTML, CSS3, jQuery, JSON, JavaScript and Bootstrap framework.
● Writing server-side web application logic, back-end components, connect the application with other web services & support the front-end developers.
● Experience in developing high-end web applications in JavaScript Frameworks (Angular JS/React JS/Vue JS) along with API building will be considered as an advantage.
● Understanding accessibility and security compliance.
● Ability to perform UI/backend tests to optimize performance
● Practical experience using the MVC architecture.
● Must be proficient in the use of GIT
● Great communication skills.
● Self-motivated with the ability to work independently or jointly in a self-directed way.
● Good to have previous experience of direct client interaction for project briefs and
updates.
If you have it all in you, we are happy to have you with us!
Lead the development of advanced quantitative trading models and mentor junior engineers.
Minimum Qualification: Bachelor's or Master's degree in any field, provided the course includes Mathematics or Economics as a subject.
Experience: 4+ years of professional experience in any field, with a strong foundation in Mathematics or Economics.
Locations: London, New York, Mumbai, Hyderabad
How to Apply:
- Login to tacoi.paromint.com.
- Navigate to your Profile.
- Copy your wallet public address from the app.
- Include your wallet public address.
- Mention the job code SQE002.
- Attach your resume to the email.
Note: Candidates will be selected for interview based on their hedging ability, especially in options and commodity derivatives on tacoi.paromint.com.
PHPJavascriptReact.jsAngular (2+)AngularJS (1.x)Reverate Tech is a product and service-based start-up, working with International Clients. Our services include Data Engineering, Web Development, BI/Data Warehousing, Enterprise Application Implementation (ERP/CRM), and NetSuite. Our product portfolio has business apps in the domain of ERP, Auto Service, and Personal Safety.
This is an exciting opportunity to work as a full-stack developer for our client SellerX.
The ideal candidate will efficiently and quickly write code in a timely and scalable way in order to improve the code-base of the company's products in meaningful ways. This candidate will be able to test the code and make adjustments where necessary.
Your background:
- 3+ years of experience working with PHP (preferably with Symfony)
- Understanding OOP principles & familiarity with best design practices
- Experience with JavaScript, Angular
- Technically proficient in SQL (preferably MySQL or MariaDB)
- Experience with NoSQL database
- Experience with Docker
We would consider it a plus if:
- You have some experience with Python or are willing to learn
- You have basic knowledge of message brokers such as RabbitMQ
- You have some experience working with AWS: RDS, S3, EC2, and Lambda functions
- Experience with search engines like Elastic Search or Solr
Benefits:
- 100% remote-working;
- Flexible working hours;
- Development of your personal strengths in a dynamic environment;
- An attractive and varied job with a high level of personal responsibility;
- A collegial togetherness and a modern management style/startup;
About our client
SellerX buys and builds Amazon businesses, helping entrepreneurs realize the next stage of their businesses and their lives. SellerX is the 3rd fastest-growing startup in Europe. Already a unicorn (1 billion euros in evaluation), SellerX plans to be a Decacorn in the coming 2-3 years.
- Interested? Join us and start your learning and growth journey.
Location: Bangalore
About Us
Valiance is a global AI & Data analytics firm helping clients build cutting-edge technology solutions for
digital transformation. We work with some of the marquee brands across India, US and APAC to build
transformative solutions for Credit Risk, Fraud, Predictive Maintenance, Quality Inspection, Data lake, IOT
analytics etc. Our team comprises 100+ professionals across Machine Learning, Data Engineering & Cloud
expertise
Required Technical and Professional Expertise:
Must have 4 -10 Years of Experience.
Graduate/Post Graduate in engineering, statistics, or a highly quantitative field
Hands on Experience in Embedded C with Linux (Train & Deploy Model)
Hands on Experience in Embedded System, c , Linux
Experience with any Advance Embedded system design Programmer Certification advantage.
Have Knowledge of OS: Linux, Embedded Linux & Linux Tools
Language – C ( Mandatory ), Shell, Python
Personal Skills:
Strong communication skills, both written and verbal
Ability to manage stakeholders' expectations and work in a high-pressure environment.
Demonstrate strong ownership & commitment to the cause of customer success.
A team player capable of high performance, flexibility in a dynamic working environment and the
ability to lead
Android DevelopmentJava
Kotlin❖ As an Android Engineer you will design, build and maintain an Android
app with the potential to unlock financial services for billions of people
in emerging markets.
❖ As a member of a small, nimble team, you'll work directly with our
product team to create beautiful, inspiring financial experiences for
our customers.
❖ One must be able to Contribute to design and development of
Android applications. (written in a mix of Java and
Kotlin).
❖ One must be able to Scope new projects and features with the
product team, and implementing them (including contributing to
some parts of our backend systems when needed).
❖ One must be able to Manage multiple projects simultaneously.
❖ One must Contribute to the overall engineering roadmap, including building out new
products for the Indian market and beyond.
❖ One must Mentor and teach other team members.
❖ One must be a passionate coder. He/She must start and/or contribute to projects
they’re excited about.
❖ One must be curious about new technologies and are eager to learn about and
contribute to all parts of the technology stack.
❖ One should be an excellent collaborator & communicator. He/She know that startup
are a team sport. He/She listen to others, aren’t afraid to speak your mind and
always try to ask the right questions.
QUALIFICATIONS
❖ One must have an experience architecting high-quality Android apps that
interact with RESTful APIs and enjoy keeping up with the latest frameworks
and development practices.
❖ One should understand the value of writing thorough test cases, and is
passionate about code quality and bug fixing.
❖ One should be excited by the prospect of working in a distributed team and
company, working with teammates from all over the world.
US A INDI A C ANADA PHI L I P P INE S Z YV K A . CO M
MUST TO HAVE
❖ Android application development
❖ Kotlin+java
❖ Product based experience
❖ Must have scaled up one project on your own.
GOOD TO HAVE
❖ Startup experience
❖ Python, ROR
- Understand the entire business process flow from business and organize Sales & BD team to achieve the organizational goals
- Ownership of department wise strategy and P&L and delivery
- Establish strategy and best practices to ensure achievement of overall sales and BD objectives
- Take a lead role in building a strong sales management culture with internal as well as external stakeholders
- Develop ingenious methods or tools to improve conversion of lead to sale, create new channels of business, new business, and brand associations
- Recruit, train and develop teams to deliver pathbreaking results
- Distribution of annual and monthly targets among team members to ensure monthly targets are achieved
- Proactively manage and creatively review the performance and progress of team members monthly, quarterly
- Spend time with external and internal stakeholders to understand and identify critical business issues and align strategies to mitigate them into strengths
- Sharer solutions with leadership on anticipated challenges, and update developments on a periodic basis
- Presenting reports and plans to Board
- Working and thriving in ad hoc environments
JavaSpring Boot- Design and development of three-tier - high performance and scalable enterprise product.
- Own feature development from definition, design through delivery.
- Hands-on full stack developer who is passionate about Go Language, Java/J2EE development, UI, SQL, building highly scalable and resilient applications, and focused on solving complex business problems
- Orientation to contribute both as a technical lead as well as an individual contributor.
- Lead the team to deliver high-quality software, by reviewing their work and mentoring them.
- Ability to research, follow up and resolve complex challenges.
- He/She will have responsibility for unit-level design, coding, unit testing, integration testing, and participating in the full SDLC
- He/She will be expected to produce high-quality code that can pass critical peer review, and work under a high-pressure and timeline-driven environment.
Qualifications
- Bachelor’s degree or higher in Computer Science or Engineering equivalent
- Minimum of 5 years experience in product development
- Responsible, organized, and possess critical thinking with good interpersonal and communication skills
- Able to demonstrate good analytical problem-solving abilities and strong leadership aptitude
- Able to work at both abstract and detailed level
- Must be fluent in English, and strong communication skills.
- Motivated self-starter that likes to work as part of a team
Technical Requirements
- Strong experience in Core Java 8 and above, Collections and Data structures.
- Develop solutions using core java, Spring / Spring Boot, JSON, Rest API, and other web technologies.
- Hands-on with UI development with strong experience in HTML5, JavaScript, CSS3, Responsive UI. An added advantage for exposure to Angular. Knowledge of Liferay will be added advantage. Ability to design and develop UIs and end-to-end integration.
- Object-oriented analysis and design using common design patterns.
- Enforcing and Writing code following good standards (well documented with good code coverage and properly tested code).
- Excellent knowledge of Relational Databases, SQL, and ORM technologies (Hibernate and Mybatis). Ability to model & design databases for high availability and high volume.
- Ability to design and build a scalable platform with APIs.
- Strong programming skills, as well as the ability to review complex code bases written by others.
- Strong knowledge of test-driven development and continuous integration
- Exposure to security, application clustering, and load balancing techniques.
- Passion for collaboration and working on agile teams. Prior experience with working on fast-paced milestones using flexible and adaptive methodologies.
- Excellent problem-solving skills.
- Manage social media handle and posts: Being into creative field the easiest way to connect with fellow artists, curators, galleries, art events, there are various ways we need to keep communication e.g. Infographics, static posts, illustrations supporting the content, art related articles, explainer videos, animations etc. writing content for all the different types of communication channels and modes.
- Jumbish events: Where there are various communication stationery need to be prepared e.g. posters, flyers, banners, etc.
- Jumbish Service offerings like Sales brochure, Coffee table books, Catalogs, Logo designs, brand stationeries, event merchandise like badges & caps, Book cover illustrations, Artist’s website, etc. Content development for the various service offerings.
Follow CutshortShubham Vishwakarma
Full Stack Developer - Averlon