Skip to content

Benchmarks

Josh Carlson edited this page Dec 31, 2023 · 12 revisions

Summary

This document outlines the results of various benchmarks performed on IP2CR in miscellaneous use cases. These will be updated from time-to-time as needed.

Testing Procedures

Latest version of time on each machine is run with the compiled binary of the specified test version.

Version Tested

v1.2.0

Target Resources

Primary: EC2 instance in us-east-1 on AWS Secondary: ALB pointing to EC2 instance in us-east-1 on AWS

Test Machines

Machine 1

Type (PC/Mac) PC
CPU AMD Ryzen 7 3700U
Memory 10 Gb
OS Linux Mint 21.2 Cinnamon
Number of Cloud Accounts 3

Machine 2

Type (PC/Mac) Mac
CPU 2.6 GHz 6-Core Intel Core i7
Memory 16 Gb
OS Ventura 13.6.1
Number of Cloud Accounts ~110

Data

Single AWS Account

Basic Search

Parameters

time ./ip2cr --ipaddr 54.85.145.114

Results

Machine Runtime
Machine 1 0m1.263s
Machine 2 0.988s

IP Fuzzing Disabled

Parameters

time ./ip2cr --ipaddr 54.85.145.114 --ip-fuzzing=false --adv-ip-fuzzing=false

Results

Machine Runtime
Machine 1 0m1.195s
Machine 2 0.661s

IP Fuzzing Disabled, Service Specified

Parameters

time ./ip2cr --ipaddr 54.85.145.114 --ip-fuzzing=false --adv-ip-fuzzing=false --svc=ec2

Results

Machine Runtime
Machine 1 0m1.132s
Machine 2 0.275s

Multiple AWS Accounts (Org Search)

Basic Search

Parameters

time ./ip2cr --ipaddr 54.85.145.114 --org-search

Results

Machine Runtime
Machine 1 0m3.544s
Machine 2 3.182s

IP Fuzzing Disabled

Parameters

time ./ip2cr --ipaddr 54.85.145.114 --ip-fuzzing=false --adv-ip-fuzzing=false --org-search

Results

Machine Runtime
Machine 1 0m2.867s
Machine 2 2.774s

IP Fuzzing Disabled, Service Specified

Parameters

time ./ip2cr --ipaddr 54.85.145.114 --ip-fuzzing=false --adv-ip-fuzzing=false --org-search --svc=ec2

Results

Machine Runtime
Machine 1 0m2.696s
Machine 2 2.547s

IP Fuzzing Disabled, Service Specified, AWS Orgs OU Specified

Parameters

time ./ip2cr --ipaddr 54.85.145.114 --ip-fuzzing=false --adv-ip-fuzzing=false --org-search --svc=ec2 --org-search-ou-id=ou-xxxx-xxxxxxx

Results

Machine Runtime
Machine 1 0m2.150s
Machine 2 1.731s

IP Fuzzing Disabled, Service Specified, AWS Orgs OU Specified, Network Mapping Enabled

Parameters

EC2
time ./ip2cr --ipaddr 54.85.145.114 --ip-fuzzing=false --adv-ip-fuzzing=false --org-search --svc=ec2 --org-search-ou-id=ou-xxxx-xxxxxxx --network-mapping
ALB
time ./ip2cr --ipaddr 54.85.145.114 --ip-fuzzing=false --adv-ip-fuzzing=false --org-search --svc=elbv2 --org-search-ou-id=ou-xxxx-xxxxxxx --network-mapping

Results

Machine Runtime
Machine 1 (EC2) 0m2.875s , (ALB) 0m3.942s
Machine 2 (EC2) 1.559s , (ALB) 1.916s

Improvements & Future Work

  • Additional test machines needed
  • Only single run used
    • Additional runs should be performed and then the results averaged for the final run time result
  • More standardized test environment
    • Optimally, these tests would be ran on various sized cloud instances using the same image