Location: Pune/Nagpur,Goa,Hyderabad/
Job Requirements:
- 9 years and above of total experience preferably in bigdata space.
- Creating spark applications using Scala to process data.
- Experience in scheduling and troubleshooting/debugging Spark jobs in steps.
- Experience in spark job performance tuning and optimizations.
- Should have experience in processing data using Kafka/Pyhton.
- Individual should have experience and understanding in configuring Kafka topics to optimize the performance.
- Should be proficient in writing SQL queries to process data in Data Warehouse.
- Hands on experience in working with Linux commands to troubleshoot/debug issues and creating shell scripts to automate tasks.
- Experience on AWS services like EMR.
About Persistent Systems
Similar jobs
Job Location: Chennai
Job Summary
The Engineering team is seeking a Data Architect. As a Data Architect, you will drive a
Data Architecture strategy across various Data Lake platforms. You will help develop
reference architecture and roadmaps to build highly available, scalable and distributed
data platforms using cloud based solutions to process high volume, high velocity and
wide variety of structured and unstructured data. This role is also responsible for driving
innovation, prototyping, and recommending solutions. Above all, you will influence how
users interact with Conde Nast’s industry-leading journalism.
Primary Responsibilities
Data Architect is responsible for
• Demonstrated technology and personal leadership experience in architecting,
designing, and building highly scalable solutions and products.
• Enterprise scale expertise in data management best practices such as data integration,
data security, data warehousing, metadata management and data quality.
• Extensive knowledge and experience in architecting modern data integration
frameworks, highly scalable distributed systems using open source and emerging data
architecture designs/patterns.
• Experience building external cloud (e.g. GCP, AWS) data applications and capabilities is
highly desirable.
• Expert ability to evaluate, prototype and recommend data solutions and vendor
technologies and platforms.
• Proven experience in relational, NoSQL, ELT/ETL technologies and in-memory
databases.
• Experience with DevOps, Continuous Integration and Continuous Delivery technologies
is desirable.
• This role requires 15+ years of data solution architecture, design and development
delivery experience.
• Solid experience in Agile methodologies (Kanban and SCRUM)
Required Skills
• Very Strong Experience in building Large Scale High Performance Data Platforms.
• Passionate about technology and delivering solutions for difficult and intricate
problems. Current on Relational Databases and No sql databases on cloud.
• Proven leadership skills, demonstrated ability to mentor, influence and partner with
cross teams to deliver scalable robust solutions..
• Mastery of relational database, NoSQL, ETL (such as Informatica, Datastage etc) /ELT
and data integration technologies.
• Experience in any one of Object Oriented Programming (Java, Scala, Python) and
Spark.
• Creative view of markets and technologies combined with a passion to create the
future.
• Knowledge on cloud based Distributed/Hybrid data-warehousing solutions and Data
Lake knowledge is mandate.
• Good understanding of emerging technologies and its applications.
• Understanding of code versioning tools such as GitHub, SVN, CVS etc.
• Understanding of Hadoop Architecture and Hive SQL
• Knowledge in any one of the workflow orchestration
• Understanding of Agile framework and delivery
•
Preferred Skills:
● Experience in AWS and EMR would be a plus
● Exposure in Workflow Orchestration like Airflow is a plus
● Exposure in any one of the NoSQL database would be a plus
● Experience in Databricks along with PySpark/Spark SQL would be a plus
● Experience with the Digital Media and Publishing domain would be a
plus
● Understanding of Digital web events, ad streams, context models
About Condé Nast
CONDÉ NAST INDIA (DATA)
Over the years, Condé Nast successfully expanded and diversified into digital, TV, and social
platforms - in other words, a staggering amount of user data. Condé Nast made the right
move to invest heavily in understanding this data and formed a whole new Data team
entirely dedicated to data processing, engineering, analytics, and visualization. This team
helps drive engagement, fuel process innovation, further content enrichment, and increase
market revenue. The Data team aimed to create a company culture where data was the
common language and facilitate an environment where insights shared in real-time could
improve performance.
The Global Data team operates out of Los Angeles, New York, Chennai, and London. The
team at Condé Nast Chennai works extensively with data to amplify its brands' digital
capabilities and boost online revenue. We are broadly divided into four groups, Data
Intelligence, Data Engineering, Data Science, and Operations (including Product and
Marketing Ops, Client Services) along with Data Strategy and monetization. The teams built
capabilities and products to create data-driven solutions for better audience engagement.
What we look forward to:
We want to welcome bright, new minds into our midst and work together to create diverse
forms of self-expression. At Condé Nast, we encourage the imaginative and celebrate the
extraordinary. We are a media company for the future, with a remarkable past. We are
Condé Nast, and It Starts Here.
Job Description
We are looking for an experienced Full Stack Engineer to join our client's development team. In this role, you will be responsible for the overall development and implementation of front and back-end software applications. Your responsibilities will extend from designing system architecture to high-level programming, performance testing, and systems integration.
To ensure success as a full stack engineer, you should have advanced programming skills, experience with application development, and excellent troubleshooting skills. Top-rated full stack engineers create and implement advanced software systems that perfectly meet the needs of the company.
Responsibilities:
- Meeting with the software development team to define the scope and scale of software projects.
- Designing software system architecture.
- Completing data structures and design patterns.
- Designing and implementing scalable web services, applications, and APIs.
- Developing and maintaining internal software tools.
- Writing low-level and high-level code.
- Troubleshooting and bug fixing.
- Identifying bottlenecks and improving software efficiency.
- Collaborating with the design team on developing micro-services.
- Writing technical documents.
Requirements:
- Bachelor’s degree in computer engineering or computer science.
- Previous relevant experience of minimum 3-5 years as a full stack engineer.
- Advanced knowledge of front-end languages including HTML5, CSS, JavaScript, C++, and JQuery.
- Proficient in back-end languages including Java, Python, Rails, Ruby, .NET, and PHP.
- Knowledge of database systems and SQL.
- Advanced troubleshooting skills.
- Familiarity with JavaScript frameworks.
- Good communication skills.
- High-level project management skills.
Come and join the market leader of distributed solar and energy solutions company and help to build the software products that will change the energy industry!!
Our client has one of the largest portfolios of distributed generation assets in India serving a diverse set of industrial and commercial customers. They offer end to end customized solar solutions including designing, procurement, engineering, permitting, project management and monitoring. Founded in 2013, the company is run by veterans of the power industry with experience in companies such as AES, NTPC, Mirant and SBI Capital Markets.
The company has received an equity investment of $150 million from I Squared Capital, a $3 billion infrastructure private equity fund focused on developing long-term sustainable infrastructure assets globally. The company' s business proposition is solar power with zero capital, no maintenance hassles and guaranteed savings for the customer from Day 1.
The company has partnered with leading Indian and multi-national companies like Dominos, Hilton Hotels, Fortis Hospitals, and others to meet their sustainability and carbon-reduction objectives. In Jan 2018, Yes Bank has signed a solar energy co-financing letter of Intent(LoI) with the company, for the solar projects which are slated to be completed by 2023.
As a EV Technical Expert / Product Manager, you will be responsible for understanding of electrification trends, markets, competition and developing the right technical requirements for the products needed in the EV portfolio.
- Working with Suppliers (vehicles, telematics, IT and others) to ensure right product is procured within cost targets and seamlessly integrated into the portfolio.
- Understanding and facilitating the readiness of the infrastructure with charging at company or client vehicle hubs.
- Understanding vehicle homologation regulations and processes.
- Responsible for IoT and CAN Communication System in the Electric Vehicle.
- Testing and Evaluation of Controllers, GPS Systems, Batteries and Chargers.
- EV Simulation Expertise: Efficiency, Range & Vehicle Performance - For 4W, 3W & 2W.
What you need to have:
- MUST be a Full-Time Graduate Engineer (Electronics / Mechanical / Automobile) from a Reputed / Premiere College.
- Minimally 7+ Years of experience in the Automotive Industry with OEMs & comes with exposure towards setting up entire ecosystem for Electric Vehicle Project is must for this role.
- Program Management Skills.
- Thorough understanding of Electric Motors & Generators, Vehicle Controls, Motor Controls, Special EV Transmissions, Telematics, IoT and BMS.
- Good understanding of overall product attributes and financials.
- Exposure to EVs and the ecosystem - Charging Infrastructure, Business model, Financial Products.
- Analytical mindset and good problem-solving skills.
- Good team player with strong interpersonal skills & leadership Skills.
- Strong verbal and written communication skills.
Our client is an IoT-enabled startup that helps businesses optimize and digitize their logistics operations. It is effectively streamlining a highly unorganized logistics space with a blend of cost-effective hardware and intelligent software and analytics.
Some of India’s renowned brands like Myntra, Flipkart, Philips, Xiaomi and others have used this innovative SaaS platform to successfully eliminate uncertainties in their supply chain.
Founded by a team of IIT Kharagpur dropouts, this Bengaluru-based location intelligence company has raised funding from angel investors of IP Ventures. It has over 100 customers and has already tracked lakhs of trips.
This platform is disrupting the supply chain & logistics operations of businesses which is heavily reliant on manual methods.
As a Enterprise Account Manager, you will be responsible for building long-term relationships with our enterprise customers.
What you will do:
- Helping customers through email, phone, online presentations, screen-share and in-person meetings
- Ensuring the timely and successful delivery of our solutions according to customer needs and objectives
- Upselling company's new products to the clients and increasing the average revenue per client
- Travelling to the clients' location and understanding their day-to-day logistics problems and designing a solution around the same
- Coordinating with the clients, product team for the constant development of new products
Desired Candidate Profile
What you need to have:- Proven account management or other relevant experience
- Demonstrated ability to communicate, present and influence credibly and effectively at all levels of the organization, including executive and C-level
- Experience in delivering client-focused solutions based on customer needs
- Excellent verbal and written communications skills
- Critical thinking and problem-solving skills
- Ability to prioritize among competing tasks
- Experience in the Logistics Industry would be preferred
●3+ years of Software Engineering or Software Development experience, preferably in a related field.
● Good knowledge of Core Java (Minimum Version 8)
● J2EE with a good understanding of Servlets and JSP
● Experience in Spring Modules – Spring IOC and AOP, Spring Boot (version 2 plus), JDBC
● Expertise in design and development of various web and enterprise – level applications using Java/J2EE
technologies such as Spring, Hibernate, Rest services.
● Web Services (including SOAP, XML, XML Schema, JSON, and REST)
● Tools required: Maven,Eclipse, Github, and Swagger
● Good knowledge of SQL and Redis (NOSql)
● Ability to document requirements and specifications
● Proven work experience as a Software Engineer or Software Developer
● Ability to develop software in Java or any other OOPS languages
● Excellent knowledge of relational databases, SQL and ORM technologies (JPA2, Hibernate)
● Experience in developing Web Applications using at least one popular Web Framework (Spring)
● Experience with test-driven development
● Proficiency in software engineering tools
Remote (Pan India)
SHIFT TIMINGS: UK Shift
Summer - 1:30pm-10:30pm IST
Winter - 2:30pm-11:30pm IST
Job brief
We are looking for a full stack developer to produce scalable software solutions. You’ll be part of a team that’s responsible for the full software development life cycle, from conception to deployment.
As a full stack developer, you should be comfortable around both front-end and back-end coding languages, development frameworks and third-party libraries. You should also be a team player with a knack for visual design and utility.
Responsibilities
- Work with development teams and product managers to ideate software solutions
- Design client-side and server-side architecture
- Build the front-end of applications through appealing visual design
- Develop and manage well-functioning databases and applications
- Write effective APIs
- Test software to ensure responsiveness and efficiency
- Troubleshoot, debug and upgrade software
- Create security and data protection settings
- Build features and applications with a mobile responsive design
- Write technical documentation
- Work with data scientists and analysts to improve software
Requirements
- 3+ years of experience as a full stack developer
- Experience developing desktop and mobile applications
- Familiarity with common stacks
- Knowledge of multiple front-end languages and libraries (e.g. HTML/ CSS, JavaScript, XML, jQuery)
- Knowledge of multiple back-end languages (e.g. C#, Java, Python) and JavaScript frameworks (e.g. Angular, React, Node.js)
- Familiarity with databases (e.g. MySQL, MongoDB), web servers (e.g. Apache) and UI/UX design
- Good communication
- Attention to detail
- Enthusiasm and aptitude to learn new technologies
- Team player
- Degree in Computer Science
Nice to have: python
Must frameworks and technologies: Springboot, kafka, MQTT, docker/kubernetes, REST APIs
Persistence layer: MongoDB, Elastic Search, Any GraphDB (Neo4j/Arango), SQL, HBase
Must have: Exposure in large scale architecture (Concept of queues, micro services, functional programming)
Must have: Strong Data structure and design principles
Expert in developing Node.js applications, Strong understanding of NPM and modular application development skills building, Proficiency and hands-on experience with Node.js, Express, Sockets, MongoDB/Elasticsearch/Redis/MySQL, Apache Kafka/Google PubSub, Experience of working in MEAN Stack is a plus)