SparkIP is an API which interfaces with Apache Spark. SparkIP was designed to streamline the analysis of massive network logs by leveraging the hugely scalable Spark framework and our new IP address data type. One of the main jobs of a security analyst is to comb over millions of network logs to identify threats in their network. The ability to efficiently query such logs not only saves time, but also makes the network safer from malicious agents. Security analysts can quickly pinpoint threats and act accordingly. Previously, querying network logs in Spark was cumbersome because users had to create complex regular expressions to match IP addresses. With our IP address type, IP addresses are baked into Spark dataframes. Security analysts can now query for specific IP addresses and IP networks as if they were querying an integer or string. Furthermore, we have implemented two IP address data structures: IP sets and IP networks. These data structures enable users to group together both individual addresses and ranges of addresses. Queries can then be run against these groups. SparkIP is currently supported for both Scala and Python.
Ryan was born and raised in Los Angeles, but made his way up to Northern California for university. He graduated in March of 2021 with a BS in Computer Science. He is interested in computer networks and backend programming. Recently, he has experimented with frontend programming using React and Typescript.
Bio: Prateek Narayanan is graduating in June 2021 with a BS in Computer Science. He is interested in full-stack development and will be starting a Master’s in Software Engineering at RIT in August.
Julian is a fourth year Computer Science student who is graduating this Spring. He has a passion for software engineering, which he will pursue after graduation.
Other Partners Day 2021 ProjectsRansomware Detection
Spark IP Address API
Dell Cloud Garbage Collection
PSLab plugin for OpenTAP
Mobile Power Station
Portable PLA Spectrometer
Plastic to Fuel Portable Diesel Lab
Simple Sort - Automated Trash, Compost, and Recycling Bin
Autonomous Fog Water Collector
Dynamic Bicycle Safety
Passive Biosensor Suite
Facial Recognition Door Lock
Mood Tracking Biosensor
Affordable Piano Amplification