Repository navigation
Expand file tree
/
Copy pathbenchmarks.html
More file actions
127 lines (120 loc) · 8.78 KB
/
Copy pathbenchmarks.html
File metadata and controls
127 lines (120 loc) · 8.78 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
<!doctype html>
<html lang="en">
<head>
<meta charset="utf-8">
<meta name="viewport" content="width=device-width, initial-scale=1">
<title>CSV import benchmarks — Scriptella</title>
<meta name="description" content="Reproducible million-row CSV import results for Scriptella 1.6, JDBC, csvsql, and PostgreSQL COPY, with local and GitHub Actions measurements.">
<link rel="canonical" href="https://scriptella.org/benchmarks.html">
<meta property="og:title" content="CSV import benchmarks — Scriptella">
<meta property="og:description" content="Reproducible million-row CSV import results for Scriptella 1.6, JDBC, csvsql, and PostgreSQL COPY, with local and GitHub Actions measurements.">
<meta property="og:type" content="website">
<meta property="og:url" content="https://scriptella.org/benchmarks.html">
<meta property="og:image" content="https://scriptella.org/images/scriptella-og.png">
<meta property="og:image:type" content="image/png">
<meta property="og:image:alt" content="Scriptella">
<meta property="og:image:width" content="1731">
<meta property="og:image:height" content="909">
<meta name="twitter:card" content="summary_large_image">
<meta name="twitter:image" content="https://scriptella.org/images/scriptella-og.png">
<meta name="twitter:title" content="CSV import benchmarks — Scriptella">
<meta name="twitter:description" content="Reproducible million-row CSV import results for Scriptella 1.6, JDBC, csvsql, and PostgreSQL COPY, with local and GitHub Actions measurements.">
<link rel="icon" href="favicon.ico" sizes="32x32">
<link rel="icon" type="image/png" href="favicon-192.png" sizes="192x192">
<script src="theme.js"></script>
<link rel="stylesheet" href="style.css?v=20261008">
</head>
<body>
<a class="skip-link" href="#main-content">Skip to content</a>
<header class="site-header">
<nav class="primary-nav" aria-label="Primary navigation">
<div class="site-header__inner">
<a class="site-logo" href="index.html" aria-label="Scriptella home">
<img class="site-logo__dark" src="images/scriptella-logo.svg" width="190" height="38" alt="Scriptella">
<img class="site-logo__light" src="images/scriptella-logo-light.svg" width="190" height="38" alt="Scriptella">
</a>
<ul>
<li><a href="reference/index.html">Documentation</a></li>
<li><a href="tutorial.html">Tutorial</a></li>
<li><a href="installation.html">Install</a></li>
<li><a href="download.html">Download</a></li>
<li><a href="https://github.com/scriptella/scriptella-etl">GitHub</a></li>
</ul>
<div class="header-controls">
<div class="language-menu" data-language-menu>
<button class="language-toggle" type="button" data-language-toggle aria-expanded="false" aria-label="Language" title="Choose language">
<svg aria-hidden="true" viewBox="0 0 24 24" focusable="false"><circle cx="12" cy="12" r="9"></circle><path d="M3 12h18M12 3a14 14 0 0 1 0 18M12 3a14 14 0 0 0 0 18"></path></svg>
<span class="visually-hidden">Choose language</span>
</button>
<div class="language-menu__dropdown" data-language-dropdown hidden>
<a href="https://github.com/scriptella/scriptella-etl/blob/master/README.zh-CN.md"><span>简体中文</span><small>README</small></a>
<a href="https://github.com/scriptella/scriptella-etl/blob/master/README.ko.md"><span>한국어</span><small>README</small></a>
<a href="https://github.com/scriptella/scriptella-etl/blob/master/README.de.md"><span>Deutsch</span><small>Geschichte</small></a>
</div>
</div>
<button class="theme-toggle" type="button" data-theme-toggle data-theme-current="system" aria-label="Color theme: System. Switch to Light." title="System theme — switch to Light">
<span class="visually-hidden">Change color theme</span>
</button>
</div>
</div>
</nav>
</header>
<main id="main-content" class="page-shell page-shell--reading">
<article class="page-content">
<h1>CSV import benchmarks</h1>
<p class="lede">One million rows, two databases, and a reproducible comparison of Scriptella 1.6, handwritten JDBC, and csvsql.</p>
<p>Batched Scriptella imported the fixture in 14.79 seconds on PostgreSQL and 9.52 seconds on MariaDB on a local development machine. Handwritten JDBC was faster; csvsql’s tested direct-import workflow took about 9–10 minutes.</p>
<p>These are exploratory results for this workload and environment. JDBC batching and csvsql chunking use different mechanisms; PostgreSQL COPY is a database-specific reference.</p>
<h2 id="local-results">Local development machine</h2>
<p>The charts show median durations from two runs of the same million-row import. Lower is faster.</p>
<figure>
<img src="images/benchmarks/local-postgres.svg" width="879" height="447" alt="Local PostgreSQL durations: Scriptella 14.792 seconds, JDBC 13.631 seconds, csvsql 557.945 seconds, and native COPY 1.672 seconds.">
<figcaption>PostgreSQL: logarithmic duration axis. Read the printed seconds for absolute differences.</figcaption>
</figure>
<figure>
<img src="images/benchmarks/local-mariadb.svg" width="879" height="447" loading="lazy" alt="Local MariaDB durations: Scriptella 9.523 seconds, JDBC 6.649 seconds, and csvsql 597.053 seconds.">
<figcaption>MariaDB: logarithmic duration axis. Read the printed seconds for absolute differences.</figcaption>
</figure>
<p>Measured on an Intel Core i9 Mac using Docker through Colima. See the <a href="https://github.com/scriptella/scriptella-benchmarks/tree/main/docs/results/2026-10-12-local">full results and environment details</a>, including individual runs and unbatched imports.</p>
<h2 id="method">About the comparison</h2>
<p>All import paths load the same CSV into a pre-created table, with one transaction per import and no indexes or transformations. Timings include client startup, parsing, insertion, and commit; setup and verification are excluded. Every measured import passed independent row-count and sampled-value checks.</p>
<p>The experiment uses Scriptella 1.6, Java 17, csvsql 2.2.0, PostgreSQL 17.11, and MariaDB 11.8.8 with normal database and driver defaults. See the <a href="https://github.com/scriptella/scriptella-benchmarks#measurement-method">methodology and limitations</a> for the full comparison.</p>
<h2 id="ci-results">GitHub Actions reproduction</h2>
<p>A separate Ubuntu 24.04 run showed the same ordering: batched Scriptella imported the million rows in 6.86 seconds on PostgreSQL and 4.45 seconds on MariaDB. These are single observations, kept separate from the local medians. See the <a href="https://github.com/scriptella/scriptella-benchmarks/tree/main/docs/results/2026-10-13-ci">CI results</a>.</p>
<h2 id="reproduce">Run it yourself</h2>
<p>The benchmark runs with Docker Compose and includes all dependencies. The <a href="https://github.com/scriptella/scriptella-benchmarks#run-the-comparison">repository instructions</a> cover running the comparison, inspecting results, and repeating it on your own hardware.</p>
<!-- GitHub star prompt: keep in sync with github-prompt.html -->
<aside class="github-prompt" aria-label="Support Scriptella">
<p>Scriptella useful? <a href="https://github.com/scriptella/scriptella-etl">Star it on GitHub</a> to help others discover it.</p>
</aside>
</article>
</main>
<footer class="site-footer">
<div class="site-footer__inner">
<p><strong>Scriptella</strong> · Licensed under the Apache License, Version 2.0.</p>
<p class="site-footer__credit">Built by <a class="pvrlabs-wordmark" href="https://pvrlabs.xyz" aria-label="PVR Labs"><span class="pvrlabs-wordmark__accent">PVR</span><span class="pvrlabs-wordmark__light">Labs</span></a></p>
<nav aria-label="Footer navigation">
<ul>
<li><a href="reference/index.html">Documentation</a></li>
<li><a href="faq.html">FAQ</a></li>
<li><a href="docs/api/index.html">API Docs</a></li>
<li><a href="docs/dtd/index.html">DTD Reference</a></li>
<li><a href="https://github.com/scriptella/scriptella-etl">GitHub</a></li>
<li><a href="benchmarks.html">Benchmarks</a></li>
<li><a href="changes.html">Change History</a></li>
<li><a href="license.html">License</a></li>
<li><a href="support.html">Support</a></li>
</ul>
</nav>
</div>
</footer>
<!-- StatCounter: existing Scriptella project configuration -->
<script>
var sc_project = 10775960;
var sc_invisible = 1;
var sc_security = "53eaed1c";
</script>
<script defer src="https://secure.statcounter.com/counter/counter.js"></script>
<!-- End StatCounter -->
</body>
</html>