- 🗓 When: Tuesday, Feb 20, 2024
- 📍 Where: Pinterest, North Wall Quay, D1
- 🎞 Talk Video: Coming soon
- ℹ️ Event page: https://www.meetup.com/pyladiesdublin/events/294583181/
Handling big data is challenging. The sheer volume of data, often in the terabytes or petabytes, makes storage, processing, and analysis difficult, requiring specialised tools and techniques. In this talk, we discover how we handle Data deletion on these big datasets at Pinterest and dive deeper into Apache Iceberg's innovative approach that transforms the landscape of big data management. From using Apache Airflow dynamic DAG mechanisms to adding customisation and robust testing, we walk through the data deletion landscape.
What date & time is right now() depends on when you ask and where, as in which timezone you are located in. Python’s datetime.datetime.utcnow() function sounds like it has all of that information to provide you with a reliable datetime.
This talk explores the attractive nuisance that is datetime.datetime.utcnow() and what “aware” and “naive” time is in python.
Jane just learned how to code and analyze data in python, her life is going to change for the better She is looking forward to apply all those skills to the day to day tasks at work ... BUT! IT does not allow to install python on the company laptop, requesting engineers to make the data available takes months, data still need to be copied manually from some old web UI to an excel sheet for analysis ... frustration This talk will cover concrete examples and tips to:
Run python from your browser, without wasting tears on setting it up (pyodide) Scraping data from some web pages into Excel (CSS selectors and pandas) Other automation/analysis ideas with python, straight from the browser
- Resources from the talk: https://github.com/lulogit/guerrilla-python
Cybersecurity Engineering is a computer science discipline that had traditionally favored programming languages such as C and Assembly and scripting languages such as Bash and JS. So where does Python fit into cybersecurity? This session introduces the benefits of python in cybersecurity and how you can use python to solve cyber challenges.
⚡️ Software engineer at Pinterest Akshita is a software engineer at Pinterest working on interesting challenges in Big data and Privacy. Her prior experience includes working with large-scale systems at Amazon Web Services and Goldman Sachs. She is always enthusiastic about exploring new technologies.
⚡️ Vectra AI, Data Scientist Anna Baron Garcia is a Data Scientist at Vectra AI. She received her MSc. in Cybersecurity Engineering and her Ph.D. in EE&CS from Embry-Riddle Aeronautical University. Her research areas include Machine Learning for Cybersecurity and Aerospace Cybersecurity.
⚡️ Pinterest, Software Engineer I studied computer science at Trinity College Dublin. Previous to Pinterest I worked for Microsoft for 3 years. Most of my professional experience is on the Frontend especially in React & Typescipt, but my work at Pinterest is Fullstack and includes python backend work as well.
⚡️ Dev @ Pinterest Luca is a Python enthusiast, working at Pinterest. Favourite colour: yellow.
- References to Luca's talk: https://github.com/lulogit/guerrilla-python
- https://www.linkedin.com/in/lodil/
- Pinterest for hosting & catering
- Coding Grace for videoing & post-production
- Python Software Foundation (PSF) - Meetup
- PyLadies
Submit your talk details: https://sessionize.com/pyladies-dublin-meetup
For example: organising, collaboration, sponsoring, hosting, and more
Questions: dublin@pyladies.com