Performance benchmarks - Revision history

Vmurrell at 07:42, 6 October 2025

2025-10-06T07:42:53Z

Vmurrell at 06:11, 11 September 2023

2023-09-11T06:11:32Z

Glenn: /* Test Dataset: ECB Exchange Rates (ECB, EXR, 1.0) */

2021-08-16T16:29:23Z

‎Test Dataset: ECB Exchange Rates (ECB, EXR, 1.0)

Glenn: /* Test Dataset: ECB Exchange Rates (ECB, EXR, 1.0) */

2021-08-16T16:27:54Z

‎Test Dataset: ECB Exchange Rates (ECB, EXR, 1.0)

Glenn: /* Data load performance */

2021-08-16T16:19:04Z

‎Data load performance

Glenn: /* Datastore: Fusion Datastore (in memory datastore persisted to the operating database) */

2021-08-16T16:17:17Z

‎Datastore: Fusion Datastore (in memory datastore persisted to the operating database)

Glenn: /* Data load performance */

2021-08-16T16:16:08Z

‎Data load performance

Glenn: /* Test Dataset: ECB Exchange Rates (ECB, EXR, 1.0) */

2021-08-16T16:05:27Z

‎Test Dataset: ECB Exchange Rates (ECB, EXR, 1.0)

Glenn: Created page with "=Data load performance= Data load performance is the time taken to persist a loaded dataset to storage. ==Test Dataset: ECB Exchange Rates (ECB, EXR, 1.0)== 3633 series
..."

2021-08-16T16:02:06Z

Created page with "=Data load performance= Data load performance is the time taken to persist a loaded dataset to storage. ==Test Dataset: ECB Exchange Rates (ECB, EXR, 1.0)== 3633 series<br>..."

New page

=Data load performance=

Data load performance is the time taken to persist a loaded dataset to storage.

==Test Dataset: ECB Exchange Rates (ECB, EXR, 1.0)==
3633 series<br>
1,207,654 observations

===Datastore: Registry Managed Database===
{| class="wikitable sortable"
|-
! Database !! Registry Environment !! Datastore Database Environment !! Load time
|-
| MySQL 8.0|| Linux, Core i5, 16 GB, SATA HDD 7200rpm storage|| (same platform as the Registry)|| 424 seconds
|-
| MySQL 8.0 || Linux, Core i5, 16 GB, SATA SSD storage|| (same platform as the Registry)|| 64 seconds
|-
| MySQL 5.7 || Windows 10, Core i7, 32GB, PCS PCIe M.2 SSD NVME (2000 MB/R, 1100 MB/W) storage || (same platform as the Registry)|| 23 seconds
|-
| MySQL 5.7 || Linux, Core i7, 16GB, EVO PLUS M.2, PCIe NVMe (up to 3500MB/R, 3200MB/W) storage || (same platform as the Registry)|| (tbc)
|}

===Datastore: Registry Managed Database===
{| class="wikitable sortable"
|-
! Database !! Registry Environment !! Operating Database Environment !! Load time
|-
| MySQL 8.0 || Linux, Core i5, 16 GB, SATA SSD storage|| (same platform as the Registry)|| 11 seconds
|-
| MySQL 5.7 || Windows 10, Core i7, 32GB, PCS PCIe M.2 SSD NVME (2000 MB/R, 1100 MB/W) storage || (same platform as the Registry)|| 6 seconds
|-
| MySQL 5.7 || Linux, Core i7, 16GB, EVO PLUS M.2, PCIe NVMe (up to 3500MB/R, 3200MB/W) storage || (same platform as the Registry)|| (tbc)
|}

← Older revision		Revision as of 07:42, 6 October 2025
Line 1:		Line 1:
−	[[Category:~~How_To~~]]	+	[[Category:RetiredFunctionality]]
	=Data load performance=		=Data load performance=

← Older revision		Revision as of 06:11, 11 September 2023
Line 1:		Line 1:
		+	[[Category:How_To]]
	=Data load performance=		=Data load performance=

@@ Line 20: / Line 20: @@
 series<br>
 ,207,654 observations<br>
-[[File:ECB Exchange Rates.zip]]
+[[File:ECB Exchange Rates.zip|Download: ECB Exchange Rates Structures and Data - ZIP]]
 ===Datastore: Registry Managed Database===

@@ Line 11: / Line 11: @@
 -08-16 15:39:56.734 INFO Thread-8 com.metadatatechnology.fcee.engine.data.writer.PercentageCompleteWriterEngine - 2.0000215% complete
   ... Import process progress
 -08-16 15:40:07.251 INFO Thread-10570 com.metadatatechnology.free.engine.data.publish.impl.ImportProcessorEngine - Percentage Complete: 99%
 -08-16 15:40:07.318 INFO Thread-10572 com.metadatatechnology.free.engine.data.publish.impl.ImportProcessorEngine - Percentage Complete: 100%

@@ Line 42: / Line 42: @@
 ! Registry !! Database !! Registry environment !! Datastore database environment !! Load time
 |-
-| 10.7.4 || MySQL 8.0 || Linux, Core i5, 16 GB, SATA SSD storage|| (same platform as the Registry)|| 11 seconds
+| 10.7.4 || MySQL 8.0 || Linux, Core i5, 16 GB, SATA SSD storage|| (same platform as the Registry)|| 12 seconds
 |-
 | 10.7.4 || MySQL 5.7 || Windows 10, Core i7, 32GB, PCS PCIe M.2 SSD NVME (2000 MB/R, 1100 MB/W) storage || (same platform as the Registry)|| 6 seconds

@@ Line 1: / Line 1: @@
 =Data load performance=
-Data load performance is the time taken to persist a loaded dataset to storage.
+Data load performance is the time taken to persist a loaded dataset to storage measured from the start of the 'process data import' operation to when its successfult completion is reported. An excerpt from a <code>FusionRegistry.log</code> logfile illustrates the princple:
 ==Test Dataset: ECB Exchange Rates (ECB, EXR, 1.0)==

@@ Line 10: / Line 10: @@
 {| class="wikitable sortable"
 |-
-! Database !! Registry Environment !! Datastore Database Environment !! Load time
+! Registry !! Database !! Registry environment !! Datastore database environment !! Load time
 |-
-| MySQL 8.0|| Linux, Core i5, 16 GB, SATA HDD 7200rpm storage|| (same platform as the Registry)|| 424 seconds
+| 10.7.4 || MySQL 8.0|| Linux, Core i5, 16 GB, SATA HDD 7200rpm storage|| (same platform as the Registry)|| 424 seconds
 |-
-| MySQL 8.0 || Linux, Core i5, 16 GB, SATA SSD storage|| (same platform as the Registry)|| 64 seconds
+| 10.7.4 || MySQL 8.0 || Linux, Core i5, 16 GB, SATA SSD storage|| (same platform as the Registry)|| 64 seconds
 |-
-| MySQL 5.7 || Windows 10, Core i7, 32GB, PCS PCIe M.2 SSD NVME (2000 MB/R, 1100 MB/W) storage || (same platform as the Registry)|| 23 seconds
+| 10.7.4 || MySQL 5.7 || Windows 10, Core i7, 32GB, PCS PCIe M.2 SSD NVME (2000 MB/R, 1100 MB/W) storage || (same platform as the Registry)|| 23 seconds
 |-
-| MySQL 5.7 || Linux, Core i7, 16GB, EVO PLUS M.2, PCIe NVMe (up to 3500MB/R, 3200MB/W) storage || (same platform as the Registry)|| (tbc)
+| 10.7.4 || MySQL 5.7 || Linux, Core i7, 16GB, EVO PLUS M.2, PCIe NVMe (up to 3500MB/R, 3200MB/W) storage || (same platform as the Registry)|| (tbc)
 |}
-===Datastore: Registry Managed Database===
+===Datastore: Fusion Datastore (in memory datastore persisted to the operating database)===
 {| class="wikitable sortable"
 |-
-! Database !! Registry Environment !! Operating Database Environment !! Load time
+! Registry !! Database !! Registry environment !! Datastore database environment !! Load time
 |-
-| MySQL 8.0 || Linux, Core i5, 16 GB, SATA SSD storage|| (same platform as the Registry)|| 11 seconds
+| 10.7.4 || MySQL 8.0 || Linux, Core i5, 16 GB, SATA SSD storage|| (same platform as the Registry)|| 11 seconds
 |-
-| MySQL 5.7 || Windows 10, Core i7, 32GB, PCS PCIe M.2 SSD NVME (2000 MB/R, 1100 MB/W) storage || (same platform as the Registry)|| 6 seconds
+| 10.7.4 || MySQL 5.7 || Windows 10, Core i7, 32GB, PCS PCIe M.2 SSD NVME (2000 MB/R, 1100 MB/W) storage || (same platform as the Registry)|| 6 seconds
 |-
-| MySQL 5.7 || Linux, Core i7, 16GB, EVO PLUS M.2, PCIe NVMe (up to 3500MB/R, 3200MB/W) storage || (same platform as the Registry)|| (tbc)
+| 10.7.4 || MySQL 5.7 || Linux, Core i7, 16GB, EVO PLUS M.2, PCIe NVMe (up to 3500MB/R, 3200MB/W) storage || (same platform as the Registry)|| (tbc)
 |}

Performance benchmarks - Revision history

Vmurrell at 07:42, 6 October 2025

Vmurrell at 06:11, 11 September 2023

Glenn: /* Test Dataset: ECB Exchange Rates (ECB, EXR, 1.0) */

Glenn: /* Test Dataset: ECB Exchange Rates (ECB, EXR, 1.0) */

Glenn: /* Data load performance */

Glenn: /* Datastore: Fusion Datastore (in memory datastore persisted to the operating database) */

Glenn: /* Data load performance */

Glenn: /* Test Dataset: ECB Exchange Rates (ECB, EXR, 1.0) */

Glenn: Created page with "=Data load performance= Data load performance is the time taken to persist a loaded dataset to storage. ==Test Dataset: ECB Exchange Rates (ECB, EXR, 1.0)== 3633 series..."

Glenn: Created page with "=Data load performance= Data load performance is the time taken to persist a loaded dataset to storage. ==Test Dataset: ECB Exchange Rates (ECB, EXR, 1.0)== 3633 series
..."