Cutshort logo
Picture the future logo
Data Engineer
Picture the future
Data Engineer
Jobdost's logo

Data Engineer

at Picture the future

Agency job
4 - 7 yrs
₹5L - ₹15L / yr
Hyderabad
Skills
PySpark
Data engineering
Big Data
Hadoop
Spark
skill iconAmazon Web Services (AWS)
Apache
Snow flake schema
skill iconPython
Relational Database (RDBMS)
RESTful APIs
skill iconC#

CORE RESPONSIBILITIES

  • Create and manage cloud resources in AWS 
  • Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, REST HTTP API, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies 
  • Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform 
  • Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations 
  • Develop an infrastructure to collect, transform, combine and publish/distribute customer data.
  • Define process improvement opportunities to optimize data collection, insights and displays.
  • Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible 
  • Identify and interpret trends and patterns from complex data sets 
  • Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders. 
  • Key participant in regular Scrum ceremonies with the agile teams  
  • Proficient at developing queries, writing reports and presenting findings 
  • Mentor junior members and bring best industry practices 

 

QUALIFICATIONS

  • 5-7+ years’ experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales) 
  • Strong background in math, statistics, computer science, data science or related discipline
  • Advanced knowledge one of language: Java, Scala, Python, C# 
  • Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake  
  • Proficient with
  • Data mining/programming tools (e.g. SAS, SQL, R, Python)
  • Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)
  • Data visualization (e.g. Tableau, Looker, MicroStrategy)
  • Comfortable learning about and deploying new technologies and tools. 
  • Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines. 
  • Good written and oral communication skills and ability to present results to non-technical audiences 
  • Knowledge of business intelligence and analytical tools, technologies and techniques.


Mandatory Requirements 

  • Experience in AWS Glue
  • Experience in Apache Parquet 
  • Proficient in AWS S3 and data lake 
  • Knowledge of Snowflake
  • Understanding of file-based ingestion best practices.
  • Scripting language - Python & pyspark

 

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Seed Funded Product-based startup
Seed Funded Product-based startup
Agency job
via Qrata by Blessy Fernandes
Bengaluru (Bangalore)
3 - 6 yrs
₹8L - ₹14L / yr
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
skill iconNodeJS (Node.js)
skill iconMongoDB
+1 more

We are looking for a MEAN Stack developer to join our Technology team. As a full-stack developer, you will work closely with our Technical Architectural members to develop microservices that focus on the educational needs of Parents and Students globally. If you have excellent programming skills and a passion for developing applications from scratch, we would like to meet you. Working at Early Steps Academy is one of the best opportunities to get first-hand experience in an early-stage startup, explore different domains, and achieve your career goals.


Qualifications:

  • A minimum of 3 years of relevant experience.
  • Strong programming skills in Javascript/Typescript with Object-oriented design.
  • Hands-on expertise in building reusable components and independently publishable packages.
  • Strong experience in HTML, Angular(2+)/React, ExpressJS, MongoDB, NodeJS, and CSS frameworks.
  • Practitioner of IaC (AWS), CI/CD, and Containerization(Docker).
  • Accessibility, Server Side Rendering, Pre-rendering, Serverless, and Agile.
  • Ability to adapt quickly to a new direction.
Read more
megaaopes solutions
Bengaluru (Bangalore)
1 - 3 yrs
₹2L - ₹3L / yr
Outbound marketing
Loan servicing
International experience
B2B Marketing

Excellent communication with good typing skills.

  • Generate leads and establish contact with businesses that may be interested in our products or services through cold calling, email outreach, networking, and referrals
  • Schedule and conduct meetings with potential clients to present products or services 
  • Follow up with leads and existing clients to provide more information, address concerns, and nurture the relationship
Read more
Seventh Triangle
divya sinha
Posted by divya sinha
Delhi, Noida, Ghaziabad, Faridabad
2 - 5 yrs
₹3L - ₹6L / yr
Agile/Scrum
JIRA
IT project management
BRD
DevOps
+3 more

-Roles and Responsibilities:-

  1. Minimum 2-3 years experience in Shopify ecosystem
  2. At least 3-5 years experience in D2C or e-commerce platform
  3. Previously worked as a project manager in development projects/ or as brand manager.
  4. Worked previously in Agile methodologies
  5. Entrepreneurial background will be a good addition
  6. Understanding of the scope of the project, create a timeline, and drive the implementation
    through to successful completion.
  7. Understand the platform end-to-end and lead solution design with the merchants.
  8. Customer Management Experience
  9. Responsibilities include developing plans to help establish our brand online, setting short-term
    and long-term department goals.
  10. Work closely with cross-functional teams on addressing project deliverables Drive project till
    Go-Live and ensure successful execution of plan, and production deployment. Collaborate with
    internal stakeholders to identify and communicate with Agency technical teams for project
    implementation.
  11. The individual should also understand the omni channel digital commerce product and how it is delivered- using a complete AGILE methodology.

 

Desired Candidate Profile :-

 

- A proactive professional who must have at least 4 to 6 years of experience into project management out of which 2-3 years must on Shopify ecosystem.

-High level of initiative and self-motivation, ability to pick things up very quickly.

-Proactive, problem solving, and Participate in estimation and solutioning in order to provide inputs for preparing delivery for the proposal

-Excellent written and verbal communication

-Ability to navigate technical applications and gain a deep understanding of functionality.

-Demonstrated drive to achieve stretch goals in a fast-paced environment.

-Can-do attitude - you must be able to think outside the box, problem-solve complex and novel issues, and roll up your sleeves to get the job done

-Must have hands on knowledge in Shopify/ e-commerce domain.



Perks and Benfits + Best work culture

 

Education

 

UG :B.Tech/B.E. in Any Specialization, Any Graduate

PG :M.Tech in Any Specialization, MBA/PGDM in Any Specialization, MCA in Any Specialization, PG Diploma in Computers

 

 

About Company

Seventh Triangle Consulting Private Limited, a Tech and Marketing integrated agency. The company prominently provides services of Digital Marketing & Technology and works with very selected rising stage businesses who have the potential and eagerness to transition from being a seller/commodity to a brand. Since 2015, STC has been consulting, helping, guiding, supporting and mentoring small and medium businesses to clear the chaos and get growth in their area of operations.

Website:- http://www.seventhtriangle.com">www.seventhtriangle.com

 

 

We invite the application of the interested candidates having relevant experience.

Read more
One Of Our Premium Clients
One Of Our Premium Clients
Agency job
via People First Consultants by Naveed Mohd
Chennai, Bengaluru (Bangalore)
5 - 10 yrs
₹3L - ₹14L / yr
Linux/Unix
Linux administration
Storage & Networking
Patch Management
Oracle Cloud

Linux Administration and VM Management with 6-8 Yrs. Exp: Client is based in US - No of positions -2

 

  • CPU/Memory/Storage Monitoring
  • Patch Management
  • Disk Space Management
  • System Log file management
  • User account Management
  • Server Start/Shut down
  • Incident/SR Handling
  • Pro-active monitoring of the customers infrastructure.
  • Follow up on tickets with the internal IT Team for resolution/SLA
  • Create and modify ansible/scripts to perform SA tasks
  • Provide input on ways to improve the stability, security, efficiency, and scalability of the environment
  • Collaborate with other teams and team members to develop automation strategies
  • and deployment processes
  • Lead and manage all Service Requests (SRs) with Oracle Support and Cloud Operations to coordinate and complete SA
  • Lead and support Oracle Cloud Infrastructure, Oracle PaaS platform administration, and Security integrations with Oracle Cloud Applications
  • Responsible for defining audit procedures to validate user permissions and creating custom user roles based on segregation of duties.
  • Monitor and investigate any system performance issues and works with Oracle, project teams and end users to identify and resolve root causes.
  • OCI infrastructure administration (Install, configure, migrations, tuning, patching, administration & monitoring).
  • Identifies emerging technologies to solve complex business problems.
  • Leads and directs all administrative support for new implementations, upgrades, and migrations.
  • Effective collaboration with infrastructure teams, application development teams, testing, and release teams.
  • Design/develop current and future state user security maps, identifying technical gaps, and building remediation plans with the new system.
  • Implementing Disaster Recovery and High Availability.
  • Applying automated configuration management & infrastructure provisioning
  • Experienced in provisioning and supporting OCI components related to Network (VCN, IPSec, FastConnect, Firewall ….)
  • Excellent written and verbal communication skills.
  • Work cross functionally with the team on system administration, access management and security management tasks in OCI
  • Responsible for coordinating the review of new release details, as well as communicating platform maintenance events to project teams and end users affected by both planned and unplanned events.
  • Establish and maintain the security policies for the firewall as new customer locations are added.
  • Establish and maintain DR plans for the network topology
  • Switch from primary IPSec tunnel to backup tunnel
  • Switch back to Primary when appropriate
  • Backup policy development and administration for OCI tenant
  • VM Backup scripting (includes testing and enhancements as needed).
  • Should be willing to work in shifts.
Read more
OJCommerce
at OJCommerce
3 recruiters
Rajalakshmi N
Posted by Rajalakshmi N
Chennai
2 - 5 yrs
₹7L - ₹12L / yr
Beautiful Soup
Web Scraping
skill iconPython
Selenium

Role : Web Scraping Engineer

Experience : 2 to 3 Years

Job Location : Chennai

About OJ Commerce: 


OJ Commerce (OJC), a rapidly expanding and profitable online retailer, is headquartered in Florida, USA, with a fully-functional office in Chennai, India. We deliver exceptional value to our customers by harnessing cutting-edge technology, fostering innovation, and establishing strategic brand partnerships to enable a seamless, enjoyable shopping experience featuring high-quality products at unbeatable prices. Our advanced, data-driven system streamlines operations with minimal human intervention.

Our extensive product portfolio encompasses over a million SKUs and more than 2,500 brands across eight primary categories. With a robust presence on major platforms such as Amazon, Walmart, Wayfair, Home Depot, and eBay, we directly serve consumers in the United States.

As we continue to forge new partner relationships, our flagship website, www.ojcommerce.com, has rapidly emerged as a top-performing e-commerce channel, catering to millions of customers annually.

Job Summary:

We are seeking a Web Scraping Engineer and Data Extraction Specialist who will play a crucial role in our data acquisition and management processes. The ideal candidate will be proficient in developing and maintaining efficient web crawlers capable of extracting data from large websites and storing it in a database. Strong expertise in Python, web crawling, and data extraction, along with familiarity with popular crawling tools and modules, is essential. Additionally, the candidate should demonstrate the ability to effectively utilize API tools for testing and retrieving data from various sources. Join our team and contribute to our data-driven success!


Responsibilities:


  • Develop and maintain web crawlers in Python.
  • Crawl large websites and extract data.
  • Store data in a database.
  • Analyze and report on data.
  • Work with other engineers to develop and improve our web crawling infrastructure.
  • Stay up to date on the latest crawling tools and techniques.



Required Skills and Qualifications:


  • Bachelor's degree in computer science or a related field.
  • 2-3 years of experience with Python and web crawling.
  • Familiarity with tools / modules such as
  • Scrapy, Selenium, Requests, Beautiful Soup etc.
  • API tools such as Postman or equivalent. 
  • Working knowledge of SQL.
  • Experience with web crawling and data extraction.
  • Strong problem-solving and analytical skills.
  • Ability to work independently and as part of a team.
  • Excellent communication and documentation skills.


What we Offer

• Competitive salary

• Medical Benefits/Accident Cover

• Flexi Office Working Hours

• Fast paced start up

Read more
EnterpriseMinds
at EnterpriseMinds
2 recruiters
Rani Galipalli
Posted by Rani Galipalli
Remote only
4 - 8 yrs
₹6L - ₹25L / yr
skill iconDocker
skill iconKubernetes
DevOps
skill iconAmazon Web Services (AWS)
Windows Azure
+2 more
  • Understanding of maintenance of existing systems (Virtual machines), Linux stack
  • Experience running, operating and maintainence of Kubernetes pods
  • Strong Scripting skills
  • Experience in AWS
  • Knowledge of configuring/optimizing open source tools like Kafka, etc.
  • Strong automation maintenance - ability to identify opportunities to speed up build and deploy process with strong validation and automation
  • Optimizing and standardizing monitoring, alerting.
  • Experience in Google cloud platform
  • Experience/ Knowledge  in Python will be an added advantage
  • Experience on Monitoring Tools like Jenkins, Kubernetes ,Terraform  etc
Read more
Simpl
at Simpl
3 recruiters
Elish Ismael
Posted by Elish Ismael
Remote only
3 - 8 yrs
₹5L - ₹30L / yr
skill iconReact Native
skill iconAndroid Development
skill iconiOS App Development
About Simpl (getsimpl.com)
The thrill of working at a start-up that is starting to scale massively is something else. Simpl (FinTech startup of the year - 2020) was formed in 2015 by Nitya Sharma, an investment banker from Wall Street and Chaitra Chidanand, a tech executive from the Valley, when they teamed up with a very clear mission - to make money simple, so that people can live well and do amazing things. Simpl is the payment platform for the mobile-first world, and we’re backed by some of the best names in fintech globally (folks who have invested in Visa, Square and Transferwise), and
has Joe Saunders, Ex Chairman and CEO of Visa as a board member.
Everyone at Simpl is an internal entrepreneur who is given a lot of bandwidth and resources to create the next breakthrough towards the long term vision of “making money Simpl”. Our first product is a payment platform that lets people buy instantly, anywhere online, and pay later. In
the background, Simpl uses big data for credit underwriting, risk and fraud modelling, all without any paperwork, and enables Banks and Non-Bank Financial Companies to access a whole new consumer market.
In place of traditional forms of identification and authentication, Simpl integrates deeply into merchant apps via SDKs and APIs. This allows for more sophisticated forms of authentication that take full advantage of smartphone data and processing power.

We are looking for an experienced (>4 years) mobile developer who is proficient with Android/iOS platforms along with exposure to React Native. You should have a sense of great ‘taste’ and be excited about building products with exceptional UX. You should be able to implement established best practices across the mobile platform including automation testing, continuous integration, and architectural patterns.

Responsibilities
1. Developing new user-facing features using Android/iOS and React Native
2. Building reusable and platform  specific components
3. Translating designs and wireframes into high-quality code
4. Optimizing components for maximum performance on Android and iOS
5. Brainstorm with designers & product managers to come up with product features

Requirements
1. Strong proficiency in tech stack (Java for Android developers & Swift, Objective-C for iOS
developers)
2. Thorough understanding of React Native and its core principles
3. Experience with popular React Native workflows (for Routing, State container, etc)
4. Experience with Native modules, bridging native code with React Native
5. Familiarity with newer specifications of ECMAScript
6. Experience with developing SDKs for Android or iOS platform is a plus
7. Familiarity with RESTful APIs
8. Familiarity with build pipelines and tools for mobile platforms
9. A knack for benchmarking and optimization
Read more
Socom
Aaihsa Nisni
Posted by Aaihsa Nisni
Remote only
3 - 7 yrs
₹3.6L - ₹4.8L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
RESTful APIs
+2 more
We are seeking a highly skilled and motivated Backend Developer to join our team and help us build a live stream shopping mobile application. In this role, you will be responsible for designing and implementing the backend infrastructure for our mobile application, including creating and maintaining APIs, integrating with third-party services, and ensuring the scalability and reliability of our systems.
Key Responsibilities:
  • Design and implement APIs and backend systems to support the functionality of our live stream shopping mobile application
  • Integrate with third-party services and APIs to enable features such as payment processing, real-time inventory updates, and user authentication
  • Collaborate with the front-end development team to ensure smooth and seamless integration between the front-end and backend systems
  • Monitor and optimize the performance and scalability of our backend systems to ensure a seamless user experience
  • Write clean, maintainable, and well-documented code
  • Stay up-to-date with industry best practices and new technologies
Requirements:
  • Bachelor's or Master's degree in Computer Science or a related field
  • 3+ years of experience in backend development
  • Strong knowledge of at least one programming language, such as Java, Python, or Ruby
  • Experience with RESTful APIs and microservices
  • Experience with database design and SQL
  • Experience with cloud computing platforms such as Amazon Web Services or Google Cloud Platform
  • Excellent problem-solving and communication skills
  • Experience with AWS
Nice-to-haves:
  • Experience with live stream technology or e-commerce platforms
  • Experience with agile development methodologies
  • Experience with containerization and orchestration platforms such as Docker and Kubernetes
Read more
Amplify Life
at Amplify Life
1 recruiter
Sushma J
Posted by Sushma J
Hyderabad
2 - 10 yrs
₹5L - ₹30L / yr
skill iconSpring Boot
Microservices
skill iconAmazon Web Services (AWS)
skill iconJava
RESTful APIs
+2 more
About the Role
Amplify looking for a Junior-Mid Java Developer for its backend platform development, responsible for developing of
micro services using Spring Boot, RESTful Services, Cloud and Container based solutions. Working closely with the
members of the UK team as well as the technical lead, the Senior Java Developer role at Amplify will be responsible for
development of the Amplify Backend platform while maintaining high-quality, robust, performance software which
meets the needs of our business and clients.
Key Areas of Responsibilities
• Functional features development of Amplify backend RESTful web services using Spring Boot.
• Ensuring coding standard, micro service system architecture is well-maintained as per standards and core
principles of business.
• Working closely with remote Product, BA and Technical teams to ensure product requirements are met.

• Working closely with members of the team to complete the tasks on time and high quality.
• Keeping current with new technologies and making recommendations to the team while maintaining and
enhancing existing product code base.
• Working with members of the QA, DevOps and delivery teams to ensure products are tested, installed and
maintained to a high standard.
• Maintaining high quality coding standards within the team and support team in code and design reviews.
• Working closely with Technical Lead to ensure dev tasks completed on-time.
• Responsible for building TDD documents, UML and functional specification documents.
Key Requirements
• At least 2+ years’ commercial experience in Java based technologies and RESTful web services. Solid Hands-on
experience of Java/J2EE and Spring Boot or Spring Framework.
• Experience in Java, its core libraries and any of open source frameworks such as Spring Boot, Spring
Integration as well as Gradle, Maven etc.
• Experience of RDBMS and SQL Knowledge as well as NoSQL databases (Highly Desirable).
• Demonstrable knowledge of at least one of software development methodology (Agile Kanban/Scrum, Agile
SAFe) and structured approaches to development. Capable of working to strict deadlines.
• Experience in working with Spring framework and cloud-based technologies like AWS. Always open to adopt
to new technologies, techniques and standards.
• Understands DevOps culture and develop software with CI/CD pipeline in-mind.
• Self-motivated, pro-active and working with the other team members in taking up initiatives appropriate to
the business and the team.
Read more
NokDok
at NokDok
4 recruiters
Varun Boughram
Posted by Varun Boughram
Bengaluru (Bangalore)
3 - 7 yrs
₹5L - ₹10L / yr
skill iconPHP
skill iconPython
skill iconNodeJS (Node.js)
NOSQL Databases
skill iconRuby on Rails (ROR)
+1 more
Nokdok is a healthcare platform that allows a Patient to centralize their Medical lifecycle and create a seamless and efficient connectivity with their Doctors and other care givers. The Backend Lead position is geared towards someone who has had experience in developing their skill and required talent and are ready to break free and build the next game changer in the market.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos