
Data Engineer
at consulting & implementation services in the area of Oil & Gas, Mining and Manufacturing Industry
- Data Engineer
Required skill set: AWS GLUE, AWS LAMBDA, AWS SNS/SQS, AWS ATHENA, SPARK, SNOWFLAKE, PYTHON
Mandatory Requirements
- Experience in AWS Glue
- Experience in Apache Parquet
- Proficient in AWS S3 and data lake
- Knowledge of Snowflake
- Understanding of file-based ingestion best practices.
- Scripting language - Python & pyspark
CORE RESPONSIBILITIES
- Create and manage cloud resources in AWS
- Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, REST HTTP API, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies
- Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform
- Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations
- Develop an infrastructure to collect, transform, combine and publish/distribute customer data.
- Define process improvement opportunities to optimize data collection, insights and displays.
- Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible
- Identify and interpret trends and patterns from complex data sets
- Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders.
- Key participant in regular Scrum ceremonies with the agile teams
- Proficient at developing queries, writing reports and presenting findings
- Mentor junior members and bring best industry practices
QUALIFICATIONS
- 5-7+ years’ experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales)
- Strong background in math, statistics, computer science, data science or related discipline
- Advanced knowledge one of language: Java, Scala, Python, C#
- Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake
- Proficient with
- Data mining/programming tools (e.g. SAS, SQL, R, Python)
- Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)
- Data visualization (e.g. Tableau, Looker, MicroStrategy)
- Comfortable learning about and deploying new technologies and tools.
- Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines.
- Good written and oral communication skills and ability to present results to non-technical audiences
- Knowledge of business intelligence and analytical tools, technologies and techniques.
Familiarity and experience in the following is a plus:
- AWS certification
- Spark Streaming
- Kafka Streaming / Kafka Connect
- ELK Stack
- Cassandra / MongoDB
- CI/CD: Jenkins, GitLab, Jira, Confluence other related tools

Similar jobs
Analytical tool: Redpoint
- Research and drawing insights
- Excellent written, oral and presentation skill
- Critical thinking and problem-solving skill
- Applications: SQL, Redpoint
Description:
- Create unique fleet rich database using multi step matching rules
- Critical thinking in identifying record survivor ship rules for identifying master record
- Data roll-up at different levels, by providing linkage across databases
- Learn issues clients are currently facing with their dataset
- Foresee the problems in solving the issue during project planning based on historical work
- Convert requirements into process flow. Customize & automate the process for upkeep
- Helps clients identify their best Industry based on multiple KPIs’
- Helps understand complete market, penetration level and available market
- Identify core segments which can be penetrated with less effort.
- Prioritize existing data to increase the penetration level
- Helps understand complete market, penetration level and available market
- Identify core segments which can be penetrated with less effort.
- Prioritize existing data to increase the penetration level
We are currently hiring for multiple Talent Acquisition Partner positions for our team at www.qrata.co, Qrata is a talent startup that helps scale funded startups globally, we work with most of the top VCs in India as well as help build remote engineering teams for US/Europe-based startups. We will be launching our talent product to analyze talent using machine learning to help our customers find the right fit.
Responsibilities
- Build an effective candidate pipeline through Inbound/Outbound sourcing channels with minimal dependency
- Source and recruit candidates by using databases, social media, and hiring portals (Naukri, IIM Jobs, LinkedIn etc.) and other creative sources
- Plan and execute candidate engagement activities, including owning the candidate experience from start to finish, pre-onboarding engagement, and post-joining engagement.
- Keep track of employee growth and the company's atmosphere and culture to ensure that it remains pleasant and productive.
- Research, mapping, company analysis, pitching, understanding the startup ecosystem, having intelligent discussions with talent and founders, preparing talent for interviews, and following up with talent are all things which need to be handled.
- Drive outcomes with zeal, think and act fast, and function long-term and in the best interests of the organization.
What are we Looking for
- Ability to work with a wide range of clients, including senior level business leaders and seasoned professional candidates within the engineering organization; proficient in using data to guide decisions and change
- Recognize how to recruit and keep the best brains from all walks of life while harnessing the potential of a diverse workforce.
- Ability to mix the position of strategic talent adviser with a sense of urgency while also managing and achieving outcomes in a fast-paced, expanding environment
- Proven track record of developing talent pipelines and sourcing
- Continuously developing talent pipelines and identifying suitable individuals is a plus.
- A thorough grasp of and application of recruitment metrics to guide decision-making is highly recommended.
- Ability to talk intelligently about the firm and respond to any technical inquiries posed by a prospective recruit
- 3 plus years of experience
Star Points if you have
- Startup Experience
- Effective client contact abilities at all levels
- Interpersonal skills and the capacity to interact effectively in a professional setting
- Consistent with our beliefs and values
- Initiative/leadership experience in projects or events
- Solid understanding of LinkedIn, Naukri, IIM platforms.
Introduction:
Tyroo’s Vidtech.ai is one of the largest independent marketing automation cloud built for the video first world. We build softwares and platforms that allow our partners to derive maximum yields on their marketing spends on various video first social platforms. We work on problems that involve building high availability, low latency solutions which require computing optimal decisions using various self-created modules as well as pre-available modules popular in the ML and Big Data world.
We are looking for a back-end developer who has at least 1 years professional experience in building systems on either Python or Node.js and is able to become an anchor/pillar for the team. The role will require you to architect and develop systems/features needed for our marketing automation products. Strong leadership and mentoring skills are also necessary so that the individual can train, educate and manage junior resources.
Key Requirements:
- Must be able to tackle complex business problems by breaking it down into set of simpler problems and architect solutions for the same
- Must exhibit thought leadership and should be committed towards mentoring and team building
- Must have excellent communication skills as the individual needs to collaborate with Business and Product team
- Must be proactive towards changing software development landscape and keep upskilling
- Must be able to contribute in setting up best practices and effective design patterns in complete development lifecycle.
Technical Requirements:
- Must have 1+ years’ experience in developing scalable systems on Python/Node.js with strong grasp on microservices and serverless architectural patterns
- Must have prior experience with databases like MySQL, Elasticsearch, MongoDB, Redis
- Must be exposed to cloud platforms like AWS or GCP and containerization using Dockers
- Must have worked with RESTful APIs and WebSockets
- Must have deep understanding of HTTP, web browsers and token-based authentication/authorization (OAuth, JWT)
- Must be experienced on Version Control Tools (Git) and Package Managers (npm, yarn, pip)
- Must adhere to coding standards and have the habit of doing unit testing along with regular and rigorous code reviews
- Should know about microservices orchestration using Kubernetes, web servers like Nginx/Apache and queuing systems like Kafka/Kinesis
A network of the world's best developers - full-time, long-term remote software jobs with better compensation and career growth. We enable our clients to accelerate their Cloud Offering, and Capitalize on Cloud. We have our own IOT/AI platform and we provide professional services on that platform to build custom clouds for their IOT devices. We also build mobile apps, run 24x7 devops/site reliability engineering for our clients.
This person MUST have:
- B.E Computer Science or equivalent
- 2+ Years of hands-on experience troubleshooting/setting up of the Linux environment, who can write shell scripts for any given requirement.
- 1+ Years of hands-on experience setting up/configuring AWS or GCP services from SCRATCH and maintaining them.
- 1+ Years of hands-on experience setting up/configuring Kubernetes & EKS and ensuring high availability of container orchestration.
- 1+ Years of hands-on experience setting up CICD from SCRATCH in Jenkins & Gitlab.
- Experience configuring/maintaining one monitoring tool.
- Excellent verbal & written communication skills.
- Candidates with certifications - AWS, GCP, CKA, etc will be preferred
- Hands-on experience with databases (Cassandra, MongoDB, MySQL, RDS).
Experience:
- Min 3 years of experience as SRE automation engineer building, running, and maintaining production sites. Not looking for candidates who have experience only as L1/L2 or Build & Deploy..
Location:
- Remotely, anywhere in India
Timings:
- The person is expected to deliver with both high speed and high quality as well as work for 40 Hours per week (~6.5 hours per day, 6 days per week) in shifts which will rotate every month.
Position:
- Full time/Direct
- We have great benefits such as PF, medical insurance, 12 annual company holidays, 12 PTO leaves per year, annual increments, Diwali bonus, spot bonuses and other incentives etc.
- We dont believe in locking in people with large notice periods. You will stay here because you love the company. We have only a 15 days notice period.
We are looking for 2-3 year expierenced React Native developer interested in building performant mobile apps on both the iOS and Android platforms. You will be responsible for architecting and building these applications, as well as coordinating with the teams responsible for other layers of the product infrastructure. Building a product is a highly collaborative effort, and as such, a strong team player with a commitment to perfection is required.
Responsibilities
- Build pixel-perfect, buttery smooth UIs across both mobile platforms.
- Leverage native APIs for deep integrations with both platforms.
- Diagnose and fix bugs and performance bottlenecks for performance that feels native.
- Reach out to the open source community to encourage and help implement mission-critical software fixes—React Native moves fast and often breaks things.
- Maintain code and write automated tests to ensure the product is of the highest quality.
- Transition existing React web apps to React Native.
Skills
- Firm grasp of the JavaScript language and its nuances, including ES6+ syntax.
- Knowledge of functional or object-oriented programming
- Ability to write well-documented, clean Javascript code
- Rock solid at working with third-party dependencies and debugging dependency conflicts
- Familiarity with native build tools, like XCode, Gradle, Android Studio.
- Understanding of REST APIs, the document request model, and offline storage
- Experience with automated testing suites, like (Jest or Mocha)
- Candidate Must be well versed with latest SDK versions, XCode, Objective C, Swift, UIKit, Cocoa etc.
- Expertise in integrating web services (XML/ JSon etc.) with iPhone applications.
- An experience in using Maps API, GPS services for iPhone/ iOS apps is required.
- Experience with third-party libraries and APIs.
- Working knowledge of the general mobile orientation, architectures, trends, and emerging technologies.
- Experience working with iOS frameworks such as Core Data, Core Animation, Core Graphics and Core Text, Core Location.
- To take care of build and release process (Adhoc releases, Final release).
- Should have worked on cocoa touch, story board, core data, auto layout.
- Hands-on experience in Cloud APIs, push notifications, social media integration, and integration of analytics is an added advantage.
- Must have good analytical, debugging, App publishing and problem solving skills.
- Self-starter having the ability to independently acquire the knowledge required in succeeding his job.
- Manage sales operations in assigned district to achieve revenue goals.
- Supervise sales team members; the BSMs, on daily basis and provide guidance whenever needed.
- Identify skill gaps and conduct trainings to sales team.
- Work with team to implement new sales techniques to obtain profits.
- Assist in employee recruitment, promotion, retention and termination activities.
- Conduct employee performance evaluation and provide feedback for improvements.
- Contact potential customers and identify new business opportunities.
- Stay abreast with customer needs, market trends and competitors.
- Maintain clear and complete sales reports for management review.
- Build strong relationships with customers for business growth.
- Analyze sales performances and recommend improvements.
- Ensure that sales team follows company policies and procedures at all times.
- Develop promotional programs to increase sales and revenue.
- Plan and coordinate sales activities for assigned projects.








.png&w=256&q=75)
