Cutshort logo
MNC logo
Data Engineer (PySpark)
MNC
Data Engineer (PySpark)
MNC's logo

Data Engineer (PySpark)

at MNC

Agency job
3 - 7 yrs
₹8L - ₹16L / yr
Bengaluru (Bangalore)
Skills
PySpark
skill iconPython
Spark
Roles and Responsibilities:

• Responsible for developing and maintaining applications with PySpark 
• Contribute to the overall design and architecture of the application developed and deployed.
• Performance Tuning wrt to executor sizing and other environmental parameters, code optimization, partitions tuning, etc.
• Interact with business users to understand requirements and troubleshoot issues.
• Implement Projects based on functional specifications.

Must-Have Skills:

• Good experience in Pyspark - Including Dataframe core functions and Spark SQL
• Good experience in SQL DBs - Be able to write queries including fair complexity.
• Should have excellent experience in Big Data programming for data transformation and aggregations
• Good at ETL architecture. Business rules processing and data extraction from Data Lake into data streams for business consumption.
• Good customer communication.
• Good Analytical skills
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Subodh Popalwar's profile image

Subodh Popalwar

Software Engineer, Memorres
For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.
Companies hiring on Cutshort
companies logos

Similar jobs

mediator between influencer and brands
mediator between influencer and brands
Agency job
via Qrata by Rayal Rajan
Bengaluru (Bangalore)
4 - 8 yrs
₹50L - ₹55L / yr
skill iconJava
skill iconPython

About the Idea


Company's Mission: Company is changing the way India discovers and shops new brands. How? We match brands to passionate creators who create authentic content enabling discovery of brand’s products. This also helps the creators earn sustainably and get recognised as curators in their fields!


Current Focus: To achieve our mission, we start by enabling brands and influencers to collaborate for mutual benefit. 

  • Creators on Youtube get access to D2C brand campaigns to boost income.
  • D2C brands gain sales through RoI-based marketing via authentic content from creators.

Progress: 

  • Business: We’ve already worked with 35+ influencers and 5 brands generating INR 85L+ in GMV and growing fast
  • Funding: MavX has raised seed funding from top-tier global VC funds and leading industry veteran angels

About the Role

Company is looking for a Tech Leader to oversee the tech org and own the entire building of the V1 product.


What will you do: 

  • Creating the marketplace product that helps brands and influencers
  • Designing the tech architecture, roadmap and vision
  • Hiring the right team to achieve product-market fit and the vision
  • Get involved in brainstorming and problem solving to solve critical product and business problems


What will you need: 

Skills:

  • Strong and demonstrated technical skills
  • Ability to hire and manage a team of coders
  • Cross-functional collaboration with product, business, design folks


Attitude:

  • Bias for quick action - progress over process
  • High empathy for small creators and small D2C brands
  • First principles thinking and a problem solving mindset
  • Strong accountability and ownership mindset


What will you gain:

  • Creating tech vision from scratch
  • Build in a fast-paced environment and test impact directly with users
  • Experience the thrills of 0-1 and PMF discovery
  • Work with a smart, young team that is highly committed to the mission
Read more
A B2B Marketplace and Retail Chains
A B2B Marketplace and Retail Chains
Agency job
via Qrata by Prajakta Kulkarni
Bengaluru (Bangalore)
3 - 9 yrs
₹5L - ₹10L / yr
Training & Development
Corporate Training
Training needs analysis
Conduct surveys with managers and employees at all levels to identify and
assess training and development needs.
● Deliver and oversee the training of Individuals and Groups.
● Supervise and monitor progress made via training programs and ensuring
employees receive complete feedback.
● Manage the new hire training and development program and share progress.
● Monitor and review the progress of New and existing employees through
questionnaires and individual feedback.
● Devise strategies and create programs to enhance employees’ performance.
● Act as a liaison between Operations, Tech, and Engineering to share userfeedback for product development.
Read more
oto capital
at oto capital
3 recruiters
Bhavya  GN
Posted by Bhavya GN
Bengaluru (Bangalore)
2 - 8 yrs
₹8L - ₹15L / yr
Program Management
Project Management
MS-Office
MS-Excel
MS-Word
+4 more

Primary roles and responsibilities -

  • Manage multiple interconnected projects, ensuring program goals are reached
  • Develop and manage scope of the projects, deadlines and activities for projects and be accountable for delivering against established business goals/objectives
  • Strategize and implement key program initiatives that adhere to organizational objectives
  • Identify key resource requirements from cross-functional teams and external vendors
  • Assume responsibility for the program’s people and vendors
  • Build and execute projects that cut across various aspects of Business
  • Work cross functionally to help influence change in getting ideas executed
  • Build and lead communication plan and develop a reinforcement strategy across the organization
  • Manage all aspects of the implementation including the human and cultural elements, and reinforcing collaboration
  • Lead and direct different cross-functional programs and projects of varied sizes and types
  • Measure project performance using appropriate systems, tools and techniques-
  • Create and maintain comprehensive project documentation-
  • Help people to design and model solutions for innovation .
  • Coordinate all cross-functional activities, collaborate with leaders in varied areas on planning and execution
  • Provide the skill and structure required to identify problems and improvement opportunities

 

 

Traits that we are looking for -

  • Experienced with MS office - Excel, Word and PPT
  • Solid organizational skills including attention to detail and multi-tasking skills
  • Should understand the product development process - to enable projects to be converted into Products
  • Excellent client-facing and internal communication skills, written and verbal
Read more
Cognologix Technologies
at Cognologix Technologies
14 recruiters
Priyal Wagh
Posted by Priyal Wagh
Remote, Pune
4 - 9 yrs
₹10L - ₹30L / yr
Spark
Hadoop
Big Data
Data engineering
PySpark
+1 more

You will work on: 

 

We help many of our clients make sense of their large investments in data – be it building analytics solutions or machine learning applications. You will work on cutting-edge cloud-native technologies to crunch terabytes of data into meaningful insights. 

 

What you will do (Responsibilities):

 

Collaborate with product management & engineering to build highly efficient data pipelines. 

You will be responsible for:

 

  • Dealing with large customer data and building highly efficient pipelines
  • Building insights dashboards
  • Troubleshooting data loss, data inconsistency, and other data-related issues
  • Product development environment delivering stories in a scaled agile delivery methodology.

 

What you bring (Skills):

 

5+ years of experience in hands-on data engineering & large-scale distributed applications

 

  • Extensive experience in object-oriented programming languages such as Java or Scala
  • Extensive experience in RDBMS such as MySQL, Oracle, SQLServer, etc.
  • Experience in functional programming languages such as JavaScript, Scala, or Python
  • Experience in developing and deploying applications in Linux OS
  • Experience in big data processing technologies such as Hadoop, Spark, Kafka, Databricks, etc.
  • Experience in Cloud-based services such as Amazon AWS, Microsoft Azure, or Google Cloud Platform
  • Experience with Scrum and/or other Agile development processes
  • Strong analytical and problem-solving skills

 

Great if you know (Skills):

 

  • Some exposure to containerization technologies such as Docker, Kubernetes, or Amazon ECS/EKS
  • Some exposure to microservices frameworks such as Spring Boot, Eclipse Vert.x, etc.
  • Some exposure to NoSQL data stores such as Couchbase, Solr, etc.
  • Some exposure to Perl, or shell scripting.
  • Ability to lead R&D and POC efforts
  • Ability to learn new technologies on his/her own
  • Team player with self-drive to work independently
  • Strong communication and interpersonal skills

Advantage Cognologix:

  •  A higher degree of autonomy, startup culture & small teams
  •  Opportunities to become an expert in emerging technologies
  •  Remote working options for the right maturity level
  •  Competitive salary & family benefits
  •  Performance-based career advancement


About Cognologix: 

 

Cognologix helps companies disrupt by reimagining their business models and innovate like a Startup. We are at the forefront of digital disruption and take a business-first approach to help meet our client’s strategic goals.

We are a Data focused organization helping our clients to deliver their next generation of products in the most efficient, modern, and cloud-native way.

Benefits Working With Us:

  • Health & Wellbeing
  • Learn & Grow
  • Evangelize 
  • Celebrate Achievements
  • Financial Wellbeing
  • Medical and Accidental cover.
  • Flexible Working Hours.
  • Sports Club & much more.
Read more
DigilyticsAI
at DigilyticsAI
1 video
2 recruiters
Komal Rathore
Posted by Komal Rathore
Gurugram
3 - 9 yrs
₹6L - ₹15L / yr
Linux/Unix
skill iconDocker
skill iconKubernetes
DevOps
skill iconAmazon Web Services (AWS)
+2 more

About Us

At Digilytics™, we build and deliver easy to use AI products to the secured lending and consumer industry sectors. In an ever-crowded world of clever technology solutions looking for a problem to solve, our solutions start with a keen understanding of what creates and what destroys value in our clients’ business.

Founded by Arindom Basu (Founding member of Infosys Consulting), the leadership of Digilytics™ is deeply rooted in leveraging disruptive technology to drive profitable business growth. With over 50 years of combined experience in technology-enabled change, the Digilytics™ leadership is focused on building a values-first firm that will stand the test of time.

We are currently focused on developing a product, Revel FS, to revolutionise loan origination for mortgages and secured lending. We are also developing a second product, Revel CI, focused on improving trade (secondary) sales to consumer industry clients like auto and FMCG players.

The leadership strongly believes in the ethos of enabling intelligence across the organization. Digiliytics AI is headquartered in London, with a presence across India.

Website: http://www.digilytics.ai">www.digilytics.ai

 

 Responsibilities

  • Experience with Azure services (Virtual machines, Containers, Databases, Security/Firewall, Function Apps etc)
  • Hands-on experience on Kubernetes/Docker/helm.
  • Deployment of java Builds & administration/configuration of Nginx/Reverse Proxy, Load balancer, Ms-SQL, Github, Disaster Recovery,
  • Linux – Must have basic knowledge- User creation/deletion, ACL, LVM etc.
  • CI/CD - Azure DevOps or any other automation tool like Terraform, Jenkins etc.
  • Experience with SharePoint and O365 administration
  • Azure/Kubernetes certification will be preferred.
  • Microsoft Partnership experience is good to have. 
  • Excellent understanding of required technologies
  • Good interpersonal skills and the ability to communicate ideas clearly at all levels
  • Ability to work in unfamiliar business areas and to use your skills to create solutions
  • Ability to both work in and lead a team and to deliver and accept peer review
  • Flexible approach to working environment and hours to meet the needs of the business and clients

 

Must Haves:

  • Hands-on experience on Kubernetes/Docker/helm.
  • Experience on Azure/Aws or any other cloud provider.
  • Linux & CI/CD tools knowledge.

 

Experience & Education:

  • A start up mindset with proven experience working in both smaller and larger organizations having multicultural exposure
  • Between 4-9 years of experience working closely with the relevant technologies, and developing world-class software and solutions
  • Domain and industry experience by serving customers in one or more of these industries - Financial Services, Professional Services, other Retail Consumer Services
  • A bachelor's degree, or equivalent, in Software Engineering and Computer Science

 

Read more
SaaS incentive gamification product Company
SaaS incentive gamification product Company
Agency job
via Jobdost by Mamatha A
Bengaluru (Bangalore)
4 - 8 yrs
₹25L - ₹30L / yr
skill iconReact.js
skill iconJavascript
skill iconRedux/Flux

What is the role?

You will be responsible for developing and designing front-end web architecture, ensuring the responsiveness of applications, and working alongside graphic designers for web design features, among other duties. You will be responsible for the functional/technical track of the project

Key Responsibilities

  • Developing front end website architecture
  • Designing user interactions on web pages
  • Integrating backend APIs
  • Ensuring cross-platform optimization for mobile phones
  • Ensuring responsiveness of applications
  • Working alongside graphic designers for web design features
  • Seeing through a project from conception to finished product
  • Integration of APIs using graphQL layer
  • Meeting both technical and consumer needs
  • Staying abreast of developments in web applications and programming languages

What are we looking for?

An enthusiastic individual with the following skills. Please do not hesitate to apply if you do not match all of it. We are open to promising candidates who are passionate about their work and are team players.

  • Education - BE/MCA or equivalent
  • 4+ years of experience
  • Agnostic/Polyglot with multiple tech stacks
  • Worked on open source technologies – ReactJs, NodeJS, graphql
  • Good experience with Front-end technologies like Javascript frameworks, Reactjs, Angularjs
  • Backend exposure – good knowledge of integrating API
  • Knowledge of cloud architecture
  • Should be innovative and communicative in approach
  • Will be responsible for functional/technical track of a project

Whom will you work with?

You will work with a top-notch tech team, working closely with the architect and engineering head. 

What can you look for?

A wholesome opportunity in a fast-paced environment that will enable you to juggle between concepts, yet maintain the quality of content, interact and share your ideas and have loads of learning while at work. Work with a team of highly talented young professionals and enjoy the benefits of being at Compass.

We are

We at Compass strive to make selling fun with our SaaS incentive gamification product.  Compass is the #1 gamification software that automates and digitizes Sales Contests and Commission Programs. With game-like elements, rewards, recognitions, and complete access to relevant information, Compass turbocharges an entire salesforce. Compass also empowers Sales Managers with easy-to-publish game templates, leaderboards, and analytics to help accelerate performances and sustain growth.

We are a fun and high-energy team, with people from diverse backgrounds - united under the passion of getting things done. Rest assured that you shall get complete autonomy in your tasks and ample opportunities to develop your strengths.

Way forward

If you find this role exciting and want to join us in Bangalore, India, then apply by clicking below. Provide your details and upload your resume. All received resumes will be screened, shortlisted candidates will be requested to join for a discussion and on mutual alignment and agreement, we will proceed with hiring.

Read more
The Links Guy
at The Links Guy
1 recruiter
Amit Raj
Posted by Amit Raj
Remote only
1 - 5 yrs
₹2L - ₹5L / yr
Market Research
Search Engine Optimization (SEO)
SEO management

What is a Data Prospectors day like?:

  • Collecting and editing data through extensive web research, using google sheets, 

  • Analyzing multiple information sources to resolve factual discrepancies in data.

  • Engaging in online discussions with colleagues on best practices for getting positive results.

  • Ensuring quality of data in the database.


You are an outstanding candidate if you: 

  • Love to spend hours in front of your PC

  •  Superb at finding information on the web

  • Can type reasonably fast

  • Love to work with a tech-loving cool virtual team.

  • Have a webcam and mic and be available for meetings.

  • Are Tech Savvy

  • Can work close to UK (GMT Time Zone) working hours of 9 am - 5 pm.

  • Have the ability to problem-solve and work independently - but can ask questions when needed

  • Be open to training (as you will be trained by my project managers and me)

  • Have  the hunger to be amazing at what you do

Educational Requirements: 

University degree or equivalent. In lieu of a degree, 2-4 years of experience working in English in a business environment. 


Work Experience at any of the following:

  • Web research

  • Link building

  • Localization projects

  • Data collection

  • Research and information analysis

     

Salary and Benefits:


  • The salary of this job (Once it moves to a full-time position of 40 hours per week), will be from $520 to $840 per month, depending on experience and competency. 
  • The higher end of range will only be for prospectors with extensive professional experience as a high-quality link prospectors.
  • But better than that, we have a set pay progression plan which means this can go up with time.
  • And a performance incentive plan which means if you’re able to hit targets, you will also qualify for a quarterly bonus as well.
  • And there’s even a chance of promotion - every management and senior position we have in the company has been from within. 
Read more
One of the Leading Fintech Industry in India.
One of the Leading Fintech Industry in India.
Agency job
via Volks Consulting by Anurag Mishra
Bengaluru (Bangalore), Pune
8 - 15 yrs
₹54L - ₹70L / yr
Engineering Management
Engineering Manager
Tech Lead
Technical Lead
Engineering Head
+5 more
• As a leader, you will be Facilitating discussions and lead decision-making on all
engineering aspects of his/her team.
• Able to define and execute the engineering plans for the areas under his/her ownership.
• Drive engineering best practices for the team.
• Define, implement and maintain the hygiene of the production systems (both engineering
and processes) for the areas under his/her ownership.
• Responsible for the health of the business directly owned by the team.
• Challenging business & product on outcomes, channelize feedback into execution, and
be accountable for engineering outputs
• Hiring, mentoring and retaining a best-of-class engineering team.
• Responsible for all stakeholder management including but not limited to business,
product, operations, and clients/vendors
Read more
CENITPRO
at CENITPRO
1 recruiter
Rumela Sarkar
Posted by Rumela Sarkar
Kolkata
1 - 2 yrs
₹2L - ₹3L / yr
Office administration
Back office
Communication Skills
Operations
Email administration
+2 more
We are hiring for Female Fresher/ Experienced Operation Executive for in house Operation Department. Tasks will include handling clients (phone calls and emails), ensuring proper operational processes are followed. It would be great opportunity for someone who is eager to learn in a dynamic environment.
Read more
Simplilearn Solutions
at Simplilearn Solutions
1 video
36 recruiters
Jincy Joseph
Posted by Jincy Joseph
Bengaluru (Bangalore)
1 - 7 yrs
₹3L - ₹6L / yr
Sales
Business Development
Presales
Lead Generation
Lead Prospecting
What should you do? • New Customer Acquisition • Conversion of leads received through various marketing channels • Preparing short-term and long-term sales plan towards reaching the assigned goals • Consistently achieve revenue targets in line with team/organizational objectives • Proactively identifying cross-selling/up-selling opportunities with the existing customers • Identifying references through the existing customer base to increase the sales pipeline
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Subodh Popalwar's profile image

Subodh Popalwar

Software Engineer, Memorres
For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.
Companies hiring on Cutshort
companies logos