![LION AND ELEPHANTS CONSULTANCY PRIVATE LIMITED's logo](/_next/image?url=https%3A%2F%2Fcdn.cutshort.io%2Fpublic%2Fimages%2Fdefault_company_picture.jpg&w=3840&q=75)
Job Title: Big Data Engineer (Java Spark Developer)
Location: Chennai, Hyderabad, Pune, Bangalore
Client: Premium Tier 1 Company
Payroll: Direct Client
Employment Type: Full time / Perm
Experience: 6-8 years
Job Description:
We are looking for a skilled Big Data Engineers using Java Spark with 6-8 years of experience in Big Data / legacy platforms, who can join immediately. Desired candidate should have design, development and optimization of real-time & batch data pipelines experience in Big Data environment at an enterprise scale applications. You will work on building scalable and high-performance data processing solutions, integrating real-time data streams, and building a reliable Data platforms. Strong troubleshooting, performance tuning, and collaboration skills are key for this role.
Key Responsibilities:
- Develop data pipelines using Java Spark and Kafka.
- Optimize and maintain real-time data pipelines and messaging systems.
- Collaborate with cross-functional teams to deliver scalable data solutions.
- Troubleshoot and resolve issues in Java Spark and Kafka applications.
Qualifications:
- Experience in Java Spark is must
- Knowledge of distributed computing, real-time data streaming, and big data technologies.
- Strong problem-solving and performance optimization skills.
- Looking for immediate joiners
![companies logos](/_next/image?url=https%3A%2F%2Fcdn.cutshort.io%2Fpublic%2Fimages%2Fhiring_companies_logos-v2.webp&w=3840&q=80)
About LION AND ELEPHANTS CONSULTANCY PRIVATE LIMITED
About
Company social profiles
Similar jobs
![skill icon](/_next/image?url=https%3A%2F%2Fcdn.cutshort.io%2Fpublic%2Fimages%2Fskill_icons%2Fpython.png&w=32&q=75)
Description
Collaborate closely with various stakeholders to gain a deep understanding of requirements and use cases. Develop detailed test plans, tools, and utilities to comprehensively test RtBrick products and features. Work closely with developers to review functional and design specifications, ensuring a thorough testing perspective. Create detailed feature test plans, design test bed configurations, and establish complex test setups based on project requirements. Develop Python and robot scripts for automated testing. Assist development engineers in diagnosing product defects, and actively participate in customer calls to troubleshoot issues, gather data, and communicate resolutions and fixes. Join our team and be at the forefront of innovation in technology.
Requirements
- Strong testing experience in any of the Layer-3 Unicast routing protocols (e.g. OSPF, BGP, IS-IS), MPLS signalling protocols (e.g. RSVP, LDP), Layer-3 VPNs, Layer2-VPNs, VPLS, Multicast VPN, EVPN,
- Hands-on experience with scripting languages or python programming to test system/application software (SWIG)
- Ability to scope and develop test cases for a given requirement including Scale/Performance testing in a distributed asynchronous environment
- Experience with "Robot Framework" for automation, RESTful API is a plus
- EC, IS , CS with networking back ground with 5 to 10 years of related experience is required
- Strong written and verbal communication skills
- Able to plan and execute tasks with minimal supervision
- Team-player, can-do attitude, will work well in a group environment while being able to contribute well on an individual basis
Responsibilities
- Collaborate closely with stakeholders, gaining insights into their unique requirements and use cases.
- Engineer comprehensive test plans, craft specialized tools and utilities for in-depth feature assessments.
- Provide a critical testing perspective by thoroughly evaluating documents like functional specs and design specs.
- Create exhaustive feature test plans and innovative test bed designs tailored to project needs.
- Configure intricate test environments, aligning them with project-specific parameters.
- Develop Python and robot scripts, automating key testing processes.
- Aid development engineers in diagnosing and resolving product defects.
- ·Engage in customer calls, actively participating in issue resolution and effectively communicating fixes.
![skill icon](/_next/image?url=https%3A%2F%2Fcdn.cutshort.io%2Fpublic%2Fimages%2Fskill_icons%2Fc.png&w=32&q=75)
At Tecknotrove, candidates will get an opportunity to learn & work on the latest cutting-edge technologies to build simulation & VR-based applications & modules.
Selected intern's day-to-day responsibilities include:
1. Assist in developing and maintaining software applications
2. Write clean, efficient, and well-documented code
3. Collaborate with team members on various projects
4. Learn and apply best practices in software development
Only those candidates can apply who:
1. are available for full time (in-office) internship
2. are available for duration of 6 months
3. have relevant skills and interests
* Women wanting to start/restart their career can also apply.
Post completion of internship candidates will be presented with an opportunity to work full time on payroll of the company based on their internship evaluation.
![skill icon](/_next/image?url=https%3A%2F%2Fcdn.cutshort.io%2Fpublic%2Fimages%2Fskill_icons%2Fphp.png&w=32&q=75)
- Selecting the tech stack, programming language, and framework
- Working on Solution architecture, and software development.
- Improving and optimizing the application architecture
- Developing APIs
- Handling Application management, including ongoing support, bug fixes, patches, minimal enhancements code refactoring, etc., maintaining infrastructure (3 rd party hosting/ servers, storage, memory, etc.)
- Managing Network security, data security
- Designing and developing databases and applications that pool, extracting and analysing large amounts of data to provide management with insights on the overall performance of the organization as well as information on markets and competitors.
- Creating dashboards and developing data collection methods.
- Debugging and QA
- Managing vendor relationships
- Managing third-party services used in the application
- Building a deployment pipeline to deliver updates safely and regularly.
- Planning software releases, Managing releases (safe and downtime-proof), tags, and versions, software releases
What you need to have:
- B. Tech in Computer Science or an MCA from a good college
- Minimum 5 years of experience
- Preferably based in Gurgaon. If not, relocation would be required since a lot of hustling and discussions will require physical meetings with the Founders.
- Should know the ins and outs of the software development life cycle
- Experience of designing, architecture, coding, testing, debugging and documenting for both front end and back end applications
- Must have knowledge about development technology like PHP, jQuery, Java script,
HTML, CSS3, JSON, XML, Bootstrap. Third party plugins, Android studio, etc. - Must have knowledge of frameworks such as Laravel, Cake
- Good knowledge of databases (MySQL), version control tools like GitHub, etc.
2. Control panel designing
3. Site commissioning and installation
4. FAT/SAT
5. Documentation(FDS,DDS, IO Assignment, Heat load calculation)
About Paytail:
We are a young Fintech Company providing BNPL Solutions and enabling instant digital finance and easy EMI’s across millions of merchants across the country. We are on the mission of simplifying affordable buying for the consumer across segments. Paytail is backed by Cholamandlam Investments, and few large Angel Investors.
Why Paytail:
Complete Ownership: Take responsibility for whatever work you do with little or no interference, get awarded on the successes for whatever work you do with little or no interference, and be accountable for the slip-ups.
Feedback driven Culture: “Feedback is the breakfast for the champions” and thus we believe feedback helps people & organization improve.
Work with top talent: Get doors open for new learning, our team is being led by the best minds in the industry.
Open Work Culture: Everyone from the CEO is easily accessible. Have any new ideas you think can revolutionize the workplace? Or, do you have some concerns about your work? Feel free to talk to the leadership.
Skills, Responsibilities & Requirements:
- 5 + years of experience with a minimum of 3 years of experience working as Key Account Manager or Customer success roles handling $ 100 Million + Accounts.
- Graduate degree in Engineering, Business, MBA is Plus
- Understanding of Fintech & lending domain across the country is a plus
- Excellent written and verbal skills and good knowledge of Excel
- Ability to work in cross-functional teams
- Build and maintain strong long-lasting relationships with assigned accounts and stakeholders.
- Understand various analytics of our customers and craft and implement strategies to grow.
- Deliver metrics and analysis to customers to ensure that they understand the value of Paytail
platforms.
- Scheduling and owning reviews like MBR, QBR with key stakeholders at the customer end.
- Owning Expansion within the set of assigned accounts.
- Work to develop and circulate the set of best practices that will be the foundation of this growing
team.
- Drive customer decision making by aligning Paytail’s value proposition with corporates problem
statements.
- Thoughtfully engage Enterprise Sales and cross-functional leaders to advance large sales pursuits.
- Coordinate internally for prompt resolution of any complaints (Enterprises) and ensure the best
possible customer experience.
- Thoughtful and empathetic by nature.
The ideal candidate should be a proactive individual with strong communication skills and a team player.
Should have hands-on experience in the following:
- He or she should have experience of at least 3-5 years in Oracle PL/SQL development.
- Excellent in-depth knowledge in Cursors, Indexes, Stored Procedures, Functions, Packages,
- Triggers, Exception Handling.
- Excellent in-depth knowledge in Collections, Records, Bulk Collect, Views
- Knowledge of Dynamic SQL
- Exposure in Performance Tuning, Explain Plan
- Should have worked in SDLC environment
- Good communication skills
- Experience in working effectively within a team as well as an individual contributor
![skill icon](/_next/image?url=https%3A%2F%2Fcdn.cutshort.io%2Fpublic%2Fimages%2Fskill_icons%2Fmachine_learning.png&w=32&q=75)
![skill icon](/_next/image?url=https%3A%2F%2Fcdn.cutshort.io%2Fpublic%2Fimages%2Fskill_icons%2Fdata_science.png&w=32&q=75)
![skill icon](/_next/image?url=https%3A%2F%2Fcdn.cutshort.io%2Fpublic%2Fimages%2Fskill_icons%2Fpython.png&w=32&q=75)
- Use data to develop machine learning models that optimize decision making in Credit Risk, Fraud, Marketing, and Operations
- Implement data pipelines, new features, and algorithms that are critical to our production models
- Create scalable strategies to deploy and execute your models
- Write well designed, testable, efficient code
- Identify valuable data sources and automate collection processes.
- Undertake to preprocess of structured and unstructured data.
- Analyze large amounts of information to discover trends and patterns.
Requirements:
- 1+ years of experience in applied data science or engineering with a focus on machine learning
- Python expertise with good knowledge of machine learning libraries, tools, techniques, and frameworks (e.g. pandas, sklearn, xgboost, lightgbm, logistic regression, random forest classifier, gradient boosting regressor etc)
- strong quantitative and programming skills with a product-driven sensibility
1. Should have deep knowledge in the relevant tech stack (JAVA, MEAN, MERN, LAMP, etc.,) with Micro-services experience.
2. Must be well versed with algorithms
3. Should have in-depth knowledge of databases - SQL, NoSQL, Mongo DB.
4. Should be able to suggest the best stack and provide an optimized approach to complete a project.
5. Should be able to covert requirements into sprint plans and estimations.
6. Should be able to jump on client calls and translate and break down business level requirements into developer goals/sprints.
7. Should be able to step in and code/solve problems when required
8. Should be able to review the code of the developers and objectively define points for improvement
9. Should be willing to learn new stacks and spend a lot of time on RnD
10. Should be able to get things done :)
11. Should be able to assess risks involved in the projects.
![skill icon](/_next/image?url=https%3A%2F%2Fcdn.cutshort.io%2Fpublic%2Fimages%2Fskill_icons%2Fphp.png&w=32&q=75)
![icon](/_next/image?url=https%3A%2F%2Fcdn.cutshort.io%2Fpublic%2Fimages%2Fsearch.png&w=48&q=75)
![companies logos](/_next/image?url=https%3A%2F%2Fcdn.cutshort.io%2Fpublic%2Fimages%2Fhiring_companies_logos-v2.webp&w=3840&q=80)