Switch from flat-cache to lru-cache for all caching needs
While currently the flat-cache is acceptable, we should look at using an LRU cache (such as https://www.npmjs.com/package/lru-cache) to cache our data instead of flat-cache. Flat-cache has a TTL eviction policy that while useful in more long-running applications or cases in which caches live through multiple runs, is currently not the case. An LRU cache with an appropriate max set would allow for a more useful cache while keeping the memory footprint lighter and keeping more often used users in cache.
The alternative would be to make an even simpler cache and just keep everything in a map during run after requesting, though this has a real cost in memory down the line as we store thousands of calls in memory.
@cguindon WDYT?