Big Data Engineer + Spark
at Multinational Company providing energy & Automation digital
Roles and Responsibilities
Similar jobs
The client is looking for an extraordinary and dynamic Engineering Manager to be
part of its Engineering team in Bangalore. You must have a good record of
architecting scalable solutions, hiring and mentoring talented teams, and working
with product managers to build great products. You must be highly analytical
and a good problem solver. You will be part of a highly energetic and innovative
team that believes nothing is impossible with some creativity and hard work.
Responsibilities
● Own the overall solution design and implementation of the core infrastructure
for backend systems. This includes requirement analysis, scope discussion,
design, architecture, implementation, delivery, and resolving production issues
related to engineering. The core back-end system is a large-scale data platform
that ingests data, applies ML models, and streams the output to the Data lake and
serving layer. As of today, we ingest 2 Bn data points every day, which need to
scale to handling 200 Bn data points every single day.
● End-end backend engineering infra charter includes Dev ops, Global
deployment, Security, and compliances according to latest practices.
● Ability to guide the team in debugging production issues and write best-of-the
breed code.
● Drive “engineering excellence” (defects, productivity through automation,
the performance of products, etc) through clearly defined metrics.
● Stay current with the latest tools, technology ideas, and methodologies; share
knowledge by clearly articulating results and ideas to key decision-makers.
● Hiring, mentoring, and retaining a very talented team.
Requirements
● 8-12 years of strong experience in product development.
● Strong experience in building data engineering (no SQL DBs, HDFS, Kafka,
Cassandra, Elasticsearch, Spark, etc) intensive backend
● Experience with DAG-based data processing is highly desirable
● Excellent track record of designing and delivering System architecture,
implementation and deployment of successful solutions in a customer-facing
role.
● Strong problem-solving and analytical skills.
● Ability to influence decision making through data and be metric driven
● Strong understanding of non-functional requirements like security, test
automation etc
● Fluency in Java, Spring, Hibernate, J2EE, REST Services
● Ability to hire, mentor and retain best-of-the-breed engineers
● Exposure to Agile development methodologies
● Ability to collaborate across teams and strong interpersonal skills
● SAAS experience a plus
Job Description – Data Science
Basic Qualification:
- ME/MS from premier institute with a background in Mechanical/Industrial/Chemical/Materials engineering.
- Strong Analytical skills and application of Statistical techniques to problem solving
- Expertise in algorithms, data structures and performance optimization techniques
- Proven track record of demonstrating end to end ownership involving taking an idea from incubator to market
- Minimum years of experience in data analysis (2+), statistical analysis, data mining, algorithms for optimization.
Responsibilities
The Data Engineer/Analyst will
- Work with stakeholders throughout the organization to identify opportunities for leveraging company data to drive business solutions.
- Clear interaction with Business teams including product planning, sales, marketing, finance for defining the projects, objectives.
- Mine and analyze data from company databases to drive optimization and improvement of product and process development, marketing techniques and business strategies
- Coordinate with different R&D and Business teams to implement models and monitor outcomes.
- Mentor team members towards developing quick solutions for business impact.
- Skilled at all stages of the analysis process including defining key business questions, recommending measures, data sources, methodology and study design, dataset creation, analysis execution, interpretation and presentation and publication of results.
- 4+ years’ experience in MNC environment with projects involving ML, DL and/or DS
- Experience in Machine Learning, Data Mining or Machine Intelligence (Artificial Intelligence)
- Knowledge on Microsoft Azure will be desired.
- Expertise in machine learning such as Classification, Data/Text Mining, NLP, Image Processing, Decision Trees, Random Forest, Neural Networks, Deep Learning Algorithms
- Proficient in Python and its various libraries such as Numpy, MatPlotLib, Pandas
- Superior verbal and written communication skills, ability to convey rigorous mathematical concepts and considerations to Business Teams.
- Experience in infra development / building platforms is highly desired.
- A drive to learn and master new technologies and techniques.
Job Overview:
We are seeking a detail-oriented and organized Accounts Receivable Specialist to join our finance team. The Accounts Receivable Specialist will be responsible for managing the company's receivables, ensuring timely and accurate invoicing, and collaborating with other departments to resolve any discrepancies. The ideal candidate will have strong analytical skills, attention to detail, and the ability to communicate effectively with both internal and external stakeholders.
Responsibilities:
- Invoicing:
- Generate and issue accurate and timely customer invoices.
- Ensure all relevant information is included on invoices, such as terms of payment, purchase order numbers, and any special billing requirements.
- Payment Processing:
- Process customer payments and apply them to the appropriate accounts.
- Reconcile discrepancies in payments and work with customers to resolve issues.
- Collections:
- Monitor accounts to identify overdue payments.
- Contact customers to follow up on outstanding balances and arrange for payment.
- Record Keeping:
- Maintain accurate and up-to-date records of all transactions related to accounts receivable.
- Prepare and maintain reports on accounts receivable status.
- Customer Relations:
- Build and maintain positive relationships with customers to facilitate prompt payment.
- Address customer inquiries and resolve any billing disputes or discrepancies.
Qualifications:
- Bachelor's degree in Finance, Accounting, or related field.
- Proven experience in accounts receivable or a related financial role.
- Strong knowledge of accounting principles and practices.
- Proficiency in using accounting software and Microsoft Excel.
- Excellent communication and interpersonal skills.
- Detail-oriented with strong organizational and analytical abilities.
- Ability to work independently and collaboratively in a team environment.
Preferred Qualifications:
- Experience with ERP systems.
At Upswing, we are committed to building a robust, scalable & secure API platform to power the world of Open Finance.
We are a passionate and self-driven team of thinkers who aspire to build the rails to connect the legacy financial sector with financial innovators through a simple and powerful banking-as-a-service (BaaS) platform.
We are looking for motivated engineers who will be working in a highly creative and cutting-edge technology environment to build a world-class financial services suite.
About the role
As part of the DevSecOps team at Upswing, you will get to work on building state-of-the-art infrastructure for the future. You will also be –
- Managing security aspects of the Cloud Infrastructure
- Designing and Implementing Security measures, Incident Response guidelines
- Conducting Security Awareness Training
- Developing SIEM tooling and pipelines end to end for vulnerability/security/incident reporting
- Developing automation and performing routine VAPT for Network and Applications
- Integrating with 3rd party vendors for the services required to improve security posture
- Mentoring people across the teams to enable best practices
What will you do if you join us?
- Engage in a lot of cross-team collaboration to independently drive forward DevSecOps practices across the org
- Take Ownership of existing, ongoing, and future DevSecOps initiatives
- Plan and Engage in Architecture discussions to bring in different angles (especially security angles) to the table
- Build Automation stack and tools for security pipeline
- Integrate different security measures and pipelines with the SIEM tool
- Conducting routine VAPT using manual and automated workflows, generating and maintaining the report for the same
- Introduce and Implement best practices across teams for a great security posture in the org
You should have
- Curiosity for on-the-job learning and experimenting with new technologies and ideas
- A strong background in Linux environment
- Proven experience in Architecting networks with security first implementation
- Experience with VAPT tooling for Networks and Applications is required
- Strong experience in Cloud technologies, multi-cloud environments, and best practices in Cloud
- Experience with at least one scripting language (Ruby/Python/Groovy)
- Experience in Terraform is highly desirable but not mandatory
- Some experience with Kubernetes, and Docker is required
- Understanding Java web applications and monitoring them for security vulnerabilities would be a plus
- Any other DevSecOps-related experience will be considered
- Provides free and subscription-based website and email services hosted and operated at data centres in Mumbai and Hyderabad.
- Serve global audience and customers through sophisticated content delivery networks.
- Operate a service infrastructure using the latest technologies for web services and a very large storage infrastructure.
- Provides virtualized infrastructure, allows seamless migration and the addition of services for scalability.
- Pioneers and earliest adopters of public cloud and NoSQL big data store - since more than a decade.
- Provide innovative internet services with work on multiple technologies like php, java, nodejs, python and c++ to scale our services as per need.
- Has Internet infrastructure peering arrangements with all the major and minor ISPs and telecom service providers.
- Have mail traffic exchange agreements with major Internet services.
Job Details:
This job position provides competitive professional opportunity both to experienced and aspiring engineers. The company's technology and operations groups are managed by senior professionals with deep subject matter expertise.
The company believes having an open work environment offering mentoring and learning opportunities with an informal and flexible work culture, which allows professionals to actively participate and contribute to the success of our services and business.
Job Role and Responsibilties:
1. Full lifecycle (SDLC) application development.
2. Designing, coding and debugging existing code.
3. Understanding of front end and user interface engineering design.
4. Software testing and quality assurance.
5. Integration of the modules in the existing systems.
6. Evaluation and identification of the new technology developments in the work domain.
7. Maintaining standard practices and compliances.
QUALIFICATION AND EXPERIENCE
A graduate degree or senior Diploma in engineering or technology with 4-8 years of experience in some or all of the following.
- PHP, Integration with MemCache, Membase, MySQL, Oracle, CDB/BDB, Error Handling and debuggers
- Data Structures,
- HTML / XHTML, CSS, java-script, Smarty
- Web Services, SOAP, XML, REST
- Code optimization, Scaling, Session management, Version control Systems
- MIME Parsing, Large data processing in PHP (encoding, parsing, escaping for special characters etc.)
- Design and develop high-quality web applications using the Django web framework
- Collaborate with other developers, product managers, and UX/UI designers to create innovative experiences
- Write reusable, testable, and efficient, clean, modular, and well-documented code
- Test and debug applications for optimal performance
- Monitor applications for performance and security issues
- Create and maintain the application's architecture
- Create and implement applications that are low-latency, high-availability, and performant
- Security and data protection implementation
- Data storage solution integration
- Develop user interfaces with React and Redux technologies
- Collaborate with other developers to ensure efficient delivery of features
- Troubleshoot, debug, and upgrade existing applications
- Monitor application performance and address any issues
- Research and suggest new technologies to improve existing applications
- Remain up-to-date with industry standards and best practices
- Managing and maintaining AWS
- Containerizing the solution with Docker
- Upgrade, update the existing solution
- Collaborate with the mobile app developer
- Stay up-to-date with the latest technologies and trends
Skills
- Proven work experience as a Django developer
- Strong knowledge of Python, HTML, CSS, and JavaScript
- Experience with relational databases such as MySQL or PostgreSQL
- Familiarity with developing RESTful APIs
- Strong knowledge of Django, Docker, AWS, React.js
- Able to use and understand different browser developer tools.
- Strong knowledge of GIT
- Able to use Postman, JIRA or similar tools
- Familiar with JSON
- Working knowledge of Django-compatible libraries like GeoDjango
Requirements:
- Bachelor’s/Master in computer science
- 5-7 years of work experience
- Excellent problem-solving skills
- Able to work in a fast, unstructured environment
- Excellent communication and collaboration skills
Must have access to FTTH internet connection
The must-have requirements: Preferably the candidate should have their own mode of transport. Travel Expense reimbursement will be provided.
- Preference: Local candidates/ candidates who know the city well in terms of areas and student hubs would be preferred.
- Experience: 0-2 years
- Job Type: Field Job
- Own vehicle required
- Excellent communication and negotiation skills
- Salary: 2LPA – 3LPA
- No. Of Openings: 5
Job Description:
- Conduct research in a specified area and collect information as per the guidance of City Head
- Assisting the city heads in pitching to the vendors (brands) and bringing them onboard. This process includes registration, briefing and providing contracts as per discussed norms and policies of the company.
- Working in tandem with the research team to understand potential vendors well.
- Formation of an on-ground report on the basis of accumulated data and submitting it to the board so that further strategies could be implemented.
- Building a network on the basis of your location so that the company can form proper channels and develop connectivity within the city.
- Submitting critical data collected about vendors to the team and ensuring all privacy policies are followed.
- Being creative in your sales pitch, contributing ideas and helping the team grow.
- Build long-term trusting relationships with clients
- Proactively seek new business opportunities in the market.
Strong expertise in AWS architecture, deployment and coding using Python and AWS Lambda functions. She/ he should also have experience with NOSQL database like MongoDB/ DynamoDB and exposure to Machine Learning. She/ he should be familiar with Ajax calls, interaction with API using JSON files and xml.
Knowledge of testing tools like JMeter and Selenium and programming languages like Javascript and Dot Net will be a big advantage.
The person should be able to guide junior resources, perform code reviews and solve performance issues as required.
As a Full Stack Developer, you should be comfortable around both front-end and back-end coding languages, development frameworks, and third-party libraries. You should also be a team player with a knack for visual design and utility.
If you’re also familiar with Agile methodologies, we’d like to meet you.
Responsibilities:
- Work with development teams and product managers to ideate software solutions
- Design client-side and server-side architecture
- Build the front-end of applications through appealing visual design
- Develop and manage well-functioning databases and applications
- Write effective APIs
- Test software to ensure responsiveness and efficiency
- Troubleshoot, debug and upgrade software
- Create security and data protection settings
- Build features and applications with a mobile responsive design
- Write technical documentation
- Work with data scientists and analysts to improve software
- Proven experience as a Full Stack Developer or similar role
- Experience developing desktop and mobile applications
- Familiarity with common stacks
- Knowledge of multiple front-end languages and libraries (e.g. HTML/ CSS, JavaScript)
- Knowledge of multiple back-end languages (e.g. Javascript, PHP, WordPress) and JavaScript frameworks (e.g. Angular, React, Node.js)
- Familiarity with databases (e.g. MySQL, MongoDB), web servers (e.g. Apache)
- Excellent communication and teamwork skills
- Great attention to detail
- Organizational skills
- An analytical mind
- Degree in Computer Science, Statistics or relevant field
As a Product Manager on ColorTokens microservice/container/serverless security platform you will be tasked with defining the next set of compelling features that will drive the creation of a compelling Zero Trust Platform which will leapfrog the competition in its security efficacy, ease of use and comprehensiveness. we plan to solve using ColorTokens ZeroTrust Platforms by providing application centric iew of containerized environments and building policy enforcement around applications, services and containers for the security administrator.
- Desired Skills
- 5-10 years of direct work experience as a product manager working for providing security for cloud, containers/microservices and serverless architectures.
- Knowledge of SaaS product delivery
- You will need to understand critical customer requirements and prioritize the creation of value added features within the platform:
- Create crisp understandable requirements starting with product requirement documents and user stories that can be worked on with engineering
- Provide thought leadership for engineering to delivery on these features and guide though the development process
- Train sales on new features developed and provide both how to sell and technical vision
- Understand how to measure, track, and optimize a SaaS security offering managing hundreds of thousands of customers and endpoints
- Constantly interact with customers to present and socialize product functionality and roadmap
- Collect and report metrics and identify trends, issues, or other important information to upper management at regular intervals to show the state of the business
- Engaging directly in a scaled agile development process with CICD pipeline
- Working with Product Marketing to help message product features in an understandable manner
Preferred Skills
- Bachelor's degree in CS or similar, MBA degree preferred
- Excellent written, and verbal communication skills
- Former experience as a software engineer or sales engineering is highly desirable
- Experience in Information Security/Cyber Security
- Comfortable in presentations in front of audiences of all sizes and backgrounds
- Ability to influence people at all levels across a broad variety of job functions
- Excellent organizational skills to juggle many tasks without losing sight of key strategic goals
We look forward to hearing from you and joining us in this exciting journey.