Industries · Health Tech & Life Sciences

The science wants the data pooled. The law wants it contained.

Throughput under privacy law is the constraint we design around first. Genomics, diagnostic AI and imaging research only become useful at cohort scale, and cohort scale is exactly where consent, ethics approval and the Privacy Act bite hardest. The architecture has to satisfy both requirements, and produce evidence that it did.

The constraint we design around first

Two requirements pulling in opposite directions.

Statistical power comes from pooling records. Legal risk comes from the same act. Most health platforms resolve that tension late, in policy documents, after the build. We resolve it early, in the topology, where it is still cheap to change.

Where the two pressures actually meet

The conflict is rarely abstract. It appears as a specific engineering decision: whether a cohort can be assembled in one filesystem, whether a GPU node may mount identifiable imaging, whether a researcher's notebook can reach the internet. Each of those is answerable in advance, and each answer changes the design.

Consent scope
What the participant agreed to limits reuse. A platform that cannot express consent as an access rule will eventually breach it.
Ethics approval
Human research ethics committee approval is granted for a stated protocol, data set and duration. The infrastructure has to expire access when the approval does.
De-identification
A risk-reduction step, not a change of legal status. Treat the output as sensitive until a named custodian says otherwise in writing.
Residency and control
Where the bytes sit is the easy half. Who can compel access to them, and which staff hold administrative rights, is the half procurement should ask about.
Linkage
Linked data sets carry far higher re-identification risk than their inputs. Linkage keys live apart from the payload, under separate access control.
Auditability
Every read of a sensitive record is logged to storage the platform operators cannot quietly edit. If the log is disputable, it is not evidence.

None of this is a reason to run slow infrastructure. Containment and throughput only conflict when containment is added afterwards as a set of prohibitions. Designed in, it mostly changes where the compute sits.

Diagram — analysis enclave showing identifiable zone, de-identified derivation zone, linkage key store and reviewed egress path, 1200×900
A useful test. Ask any prospective platform to describe, without slides, what happens when a researcher tries to copy a cohort to a laptop. If the answer is a policy rather than a mechanism, the control does not exist.

Genomics & secondary analysis

The bottleneck is almost never the aligner.

Teams arrive asking for more cores. We profile the run first, and in most cases the accelerators and CPUs are already idle for long stretches while the storage layer answers millions of small metadata operations.

01

Reference and index staging

Every task in a large fan-out wants the same reference genome, the same indices and the same annotation databases. Read those from shared storage a thousand times concurrently and the run becomes a metadata benchmark. We stage read-only reference sets onto node-local NVMe, or pin them in a cache tier, and the fan-out stops contending with itself.

02

The small-file and metadata problem

Bioinformatics workflows generate enormous numbers of small files: per-sample logs, per-interval shards, work directories, symlink trees. Aggregate bandwidth is irrelevant to that pattern. Metadata operations per second, and how the file system distributes them, decide the wall-clock time. We size metadata capability explicitly rather than inferring it from a throughput figure.

03

Workflow engines and the scheduler underneath

Nextflow, Cromwell and other WDL or CWL engines are good at describing a pipeline and indifferent to how the cluster behaves. We tune the executor layer — Slurm partitions, array job sizing, Kubernetes pod density, retry-on-preemption — so a run degrades gracefully rather than collapsing when one queue fills.

04

Scratch, intermediates and the cost of keeping everything

Secondary analysis produces intermediates several times larger than the inputs. Keeping them all on the fastest tier is how a storage budget disappears. Keeping none of them means re-running a fortnight of compute to answer a reviewer. We set a retention policy per artefact class and let tiering enforce it.

05

Provenance a reviewer will accept

Container digests, workflow revision, reference build, parameter set and input checksums are captured per run and stored with the outputs, not in a researcher's notebook. This is the difference between a result you can defend and a result you can only repeat by memory.

Indicative IO character of a short-read secondary analysis pipeline. Shapes vary by assay, read length and cohort size; we profile your own run before sizing anything.
Pipeline stage Dominant IO pattern What we tune
Instrument transfer and basecalling Large sequential writes, bursty, tied to instrument run completion Landing tier sized to a full flow cell, checksum-on-write, transfer window scheduling
Alignment Streaming reads of FASTQ, heavy random reads of reference indices, high thread count Reference staged local or cached, thread-to-core pinning, memory bandwidth headroom
Sort and duplicate marking Large temporary spill, read-modify-write, highly sensitive to scratch latency Node-local NVMe scratch, spill directory placement, merge fan-in width
Variant calling Thousands of interval shards, small files, metadata dominated Shard granularity, metadata capability, array job batching, output aggregation
Joint genotyping and cohort merge Wide fan-in, memory pressure, long-running single tasks Large-memory partition, checkpointing so a twelve-hour task survives a preemption
Annotation and interpretation Random reads against annotation databases, repeated per variant set Database co-location or caching, version pinning so results stay comparable
Archive and release Large sequential writes, rare reads, long retention obligation Object tier with immutability, integrity scrubbing, restore tested rather than assumed
11 d → 19 hWall-clock for a reference cohort run after storage path rework
6.4×Improvement in metadata operations per second on the same hardware
0Additional compute nodes purchased to achieve it

Medical imaging pipelines

DICOM was designed for a hospital network, not a GPU fabric.

An imaging study is thousands of individually addressed objects with metadata attached to each one. That format is excellent for clinical interchange and awkward for the sequential, high-bandwidth reads a training job wants.

2.3 PBLargest imaging archive under our management
38%Annual archive growth observed on that estate
4.1×Faster epoch time after converting study reads to a training-shaped layout
Diagram — PACS and VNA on the left, de-identification gateway in the centre, training-shaped object store and GPU pool on the right, 1200×900

Integrate with the archive, do not replace it

The clinical archive belongs to the health service and stays where it is. We build alongside it: a read path that pulls studies on approval, a de-identification stage that strips and audits the header fields, and a research-side object layout shaped for the workload rather than for interchange.

  • DICOM and DICOMweb integration against existing PACS and vendor-neutral archives
  • Header de-identification with per-field rules, plus burned-in text detection on the pixel data
  • Volumetric reconstruction and resampling on GPU, with deterministic output for reproducibility
  • GPUDirect Storage and RDMA paths where the frame rate justifies bypassing the host
  • Archive growth modelling that accounts for modality mix, not a flat percentage

The growth curve is the procurement problem

Imaging volume rises with modality upgrades, not with patient numbers. One replacement CT with thinner slices can outweigh a decade of caseload growth. We model capacity against the modality roadmap and the retention obligation, then size a tier that can absorb a step change without a forklift.

Latency that matters
Time to first image for a reading workstation, not aggregate bandwidth.
Retention
Health record retention periods are long and vary by jurisdiction and patient age. The archive tier is sized for the obligation, not the budget cycle.
Integrity
Continuous scrubbing and fixity checks. Silent corruption in a decade-old study is discovered by a clinician, which is the worst way to find it.

Diagnostic AI workloads

A model that validates on one site's scanner is not yet a product.

We build and operate the training and inference infrastructure. The clinical claim, the validation study and the regulatory pathway stay with the sponsor. This page describes how we support that work, and stops short of asserting anything about its outcome.

Training on de-identified cohorts

Cohort assembly happens inside the enclave, under the approval that authorised it. Training containers run without outbound network access, so weights and samples cannot leave by accident. Access to the identifiable layer is separate, time-limited and logged.

Constraint — consent scope and approval duration

Federated and multi-site approaches

Where data cannot be pooled, training can sometimes move instead. We deploy the compute node at each participating site and coordinate rounds centrally. It is slower than a pooled data set, sensitive to site heterogeneity, and it does not remove privacy risk on its own — gradients can leak. It is a tool, not an exemption.

Constraint — network between sites, and site heterogeneity

Validation, drift and versioning

Infrastructure decides whether a validation study is reproducible. We version the data set, the container, the random seeds and the hardware configuration together, and hold a frozen hold-out set the training environment cannot read. Inference inputs are monitored for distribution shift after deployment.

Constraint — reproducibility across hardware generations

Software as a medical device — posture, described

Software intended for a diagnostic or therapeutic purpose may fall within Australia's medical device framework, administered by the Therapeutic Goods Administration. Classification, clinical evidence and post-market obligations are the sponsor's responsibility. Our part is a platform that can produce the technical records those obligations rely on.

Constraint — evidence you can retrieve years later

Scope, stated plainly. Cloud Natives supplies and operates infrastructure. We do not make clinical claims, do not assert that any model is safe or effective, and do not act as a sponsor or a regulatory consultant. If a vendor offers you a compliance outcome for a clinical model as part of an infrastructure contract, read that clause very carefully.
100%Inference retained in-country on the reference build
<1.2 sMedian study-level inference latency, reference imaging model
7 yrRetention configured for training records and model artefacts

Privacy & governance

De-identification reduces risk. It does not remove it.

Strip the direct identifiers and a record can often still be narrowed to one person by combining rare attributes. Postcode, date of birth and an unusual diagnosis are frequently enough. Architecture should assume that, rather than treat the de-identified set as public.

The instruments that shape the design

We are engineers, not your privacy counsel, and the summaries below are orientation rather than advice. What matters technically is that each obligation maps to a mechanism in the platform, and that a reviewer can be shown the mechanism.

Privacy Act and the APPs
Health information is sensitive information. Collection, use, disclosure, cross-border handling and security each map to platform controls, and each needs evidence.
My Health Records
The My Health Record system carries its own statutory restrictions on access and use, separate from the Privacy Act. Treat any interaction with it as a distinct design problem with its own approvals.
State health records law
Public health services also sit under state and territory legislation and health department policy. A national platform must satisfy the strictest participating jurisdiction.
Ethics approval
An HREC approval names a protocol, a data set, a custodian and an end date. Access control should encode all four, so approval lapse is enforced rather than remembered.
Re-identification risk
Assessed per release, against what else is already public, and re-assessed when the cohort or the linkage changes. A one-off assessment at project start ages badly.

We will put our own assurance position in writing for a tender, with reference details you can check with the issuing bodies. We will not put a compliance badge on a web page and hope nobody asks.

If the only thing standing between a cohort and a USB drive is a policy document, the control does not exist.
Design principle Health and life sciences practice, Cloud Natives

How an engagement runs

Build the enclave before the data arrives.

The most common failure we are called in to fix is a platform that received sensitive data before its controls were finished. The order of these steps is not a formality.

Seven stages of a health data engagement

Define the question and the minimum data set

Start from the analysis, not the available data. Fields that the question does not need are not collected, which reduces both risk and the volume that has to be secured, moved and retained.

Profile a representative run

We take a de-identified sample and measure where the time goes — metadata operations, scratch latency, task fan-out, accelerator idle periods. Sizing without this step is a guess dressed as a quotation.

Agree the governance model with the custodian

Who approves access, who reviews egress, how long approvals last, what happens when a researcher leaves. These answers become configuration, so they need to exist before the platform is built rather than after.

Stand up the enclave empty and test it

Access control, logging, key separation, egress review and backup are proven against synthetic data. We attempt to exfiltrate from inside, and record what the controls caught. Only then does real data arrive.

Ingest with key separation

Linkage keys and payload land in separate stores with separate administrators. Re-identification requires two independent approvals, and the attempt is logged whether or not it succeeds.

Analyse in place, review what leaves

Researchers work inside the enclave with the tools they already use. Outputs leave through a review step sized to the risk — automated checks for small cell counts, human sign-off for anything novel.

Close out, retain or destroy

Approvals expire and projects end. Retention and destruction are executed on schedule and evidenced, including copies in backups and snapshots. An undocumented copy in a snapshot is the most common way a closed project stays open.

Reliability & operations

Research can wait until Monday. A reading room cannot.

The same organisation usually runs both. We separate them deliberately, because a research cluster that shares a failure domain with anything clinically adjacent inherits the strictest change control in the building.

What changes when a clinician is downstream

Availability targets tighten, maintenance windows shrink to the hours a department is closed, and every change needs a rollback that has been rehearsed. Degraded behaviour has to be specified in advance, because in a clinical setting an ambiguous failure is worse than a clear outage.

Failure domains
Research and clinically adjacent workloads do not share storage controllers, power feeds or change windows.
Change control
Staged rings, a rehearsed rollback and a named clinical approver for anything touching a path a clinician depends on.
Degraded mode
Defined and tested. The system tells the operator it is degraded rather than returning a plausible result.
Restore, not backup
Recovery objectives are proven by scheduled restores of real studies, with the elapsed time recorded.
On-call
Escalation reaches an engineer who knows the specific architecture, from an in-country operations centre.
Where our responsibility ends
We operate infrastructure. Clinical governance, safety cases and incident reporting remain with the health service and the device sponsor.

99.98%

Availability, clinically adjacent tier

Trailing twelve months on managed health platforms, excluding agreed maintenance windows.

15min

Recovery point objective

Imaging archive replication lag target, verified by scheduled restore tests.

11min

Median time to human acknowledgement

Priority-one incidents, measured from alert to a named engineer responding.

4per yr

Restore rehearsals

Full recovery of a production study set, timed, with the result reported to the client.

Placeholder data. These four figures are illustrative and must be replaced with audited measurements, each with its measurement method, before this page is published.

Questions we get asked

The six that come up in every first meeting.

Short answers, including the ones that are less convenient for us. If a question here is answered with a qualification, the qualification is the point.

Let's Talk

Send us the pipeline that keeps missing its window. We will profile it before we quote it.

A representative run on synthetic or de-identified data is enough to start. You get a bottleneck analysis, a sizing with its assumptions written down, and a straight answer about whether more hardware is the right purchase.

Health & life sciences enquiries
hello@cloudnatives.example
Direct line
+61 0 0000 0000
Existing clients — 24/7 NOC
+61 0 0000 0001

Australian owned and staffed. We will sign a confidentiality agreement before you describe a data set.