Performance Considerations
FME has, at its heart, a very powerful and speedy translation and transformation engine:
However, as fast as FME is, a significant factor in performance is in the design and optimization of the workspace. To create a well-designed workspace you need to know what sort of design flaws can impair performance, you need to be able to measure how well your workspace is performing, and you need to know what techniques you can apply to avoid performance bottlenecks.
But, in fact, perhaps the first thing to discuss is what we even mean by "performance"!
What do we mean by Performance?
According to Wikipedia, performance is a measure of the amount of useful work accomplished relative to the time and resources used.
In FME terms, good performance is the ability to process spatial and tabular data with the correct results (useful) as fast as possible (time) and using as little memory and disk space (resources) as possible.
What Can Impair Performance?
There are various factors – you might call them bottlenecks – that can cause FME to run slower than you might hope. Most of the content of this chapter covers how to overcome or relieve these factors.
Excessive Disk Operations
Physical disk drive throughput is relatively slow compared to other computing processes; therefore the more FME has to read and write to a physical disk drive, the more performance is impaired. The best performance comes from storing temporary data in memory, rather than on disk.
Underuse of Resources
Performance can be impaired when an FME translation is not using all of the available system resources. For example, there are few licensing limits to prevent FME from using all of the CPU cores on a system, and more memory resources are available to 64-bit FME than 32-bit.
Excessive Data Amounts
If performance is described as the amount of “useful” work, then nothing is going to impair performance more than unnecessary processing. The more excess information that gets read, and the further it is carried into the workspace, the less useful the work is, and the more performance suffers.