NVIDIA L40S 48GB Pci-e Accelerator

Introduction

Do you require higher performance for artificial intelligence (AI) training and inference, high-performance computing (HPC) or graphics? NVIDIA Accelerators for HPE help solve the world’s most important scientific, industrial, and business challenges with AI and HPC. Visualize complex content to create cutting-edge products, tell immersive stories, and reimagine cities of the future. Extract new insights from massive datasets. Hewlett Packard Enterprise servers with NVIDIA accelerators are designed for the age of elastic computing, providing unmatched acceleration at every scale.

What is new supporting point:
NVIDIA H200 NVL is ideal for air-cooled enterprise rack designs that require flexible configurations.
With up to four GPUs connected by NVIDIA NVLink™ and a 1.5x memory increase, LLM inference can be accelerated up to 1.7x and HPC up to 1.3x on H200 NVL compared to H100 NVL.
NVIDIA H200 NVL comes with a five-year NVIDIA AI Enterprise subscription and simplifies the way you build an enterprise AI-ready platform.
Third generation NVLink doubles the GPU-GPU direct bandwidth.
Third-generation RT cores for speeding up rendering workloads.
NVIDIA confidential computing is a built-in security feature of Hopper-based accelerators.

Processor

CUDA

Yes

CUDA cores

18176

Graphics processor family

NVIDIA

Graphics processor

L40S

Processor frequency

1065 MHz

Processor boost clock speed

2520 MHz

Parallel processing technology support

Not supported

Memory

Memory bus

384 bit

Memory clock speed

9001 MHz

Memory bandwidth (max)

864 GB/s

Discrete graphics card memory

48 GB

Graphics card memory type

GDDR6

Memory bandwidth (max)

864 GB/s

Ports & interfaces

Interface type

PCI Express x16 4.0

DisplayPorts quantity

4

DisplayPort version

1.4a

Performance

TV tuner integrated

No

Dual Link DVI

No

Design

Cooling type

Passive

Form factor

Full-Height/Full-Length (FH/FL)

Bracket height

Full-Height (FH)

Number of slots

2

Product colour

Beige

Power

Supplementary power connectors

1x 16-pin

Power consumption (max)

350 W

Operational conditions

Operating temperature (T-T)

0 - 50 °C

Operating relative humidity (H-H)

5 - 85%

Non-operating relative humidity (non-condensing)

5 - 95%

Storage temperature (T-T)

-40 - 75 °C

Weight & dimensions

Depth

267 mm

Height

111 mm

Width

34.7 mm

Weight

1.7 kg

Depth

267 mm

Height

111 mm

Width

34.7 mm

Other features

Weight

1.7 kg

Weight (imperial)

1.7 kg (3.74 lbs)

Height (imperial)

11.1 cm (4.37")

Compatible products

HPE Mainstream Compute Platforms