Benchmark: (ColorfulCakeChen) CNN Embedding (96b9f70ed93b7160185f70fcb501b92334761434) 206

(ColorfulCakeChen) CNN Embedding (96b9f70ed93b7160185f70fcb501b92334761434) 206 (version: 206)

Comparing performance of: Async wait for init (WASM) vs (WASM) AddGatherReshape_channelMultiplier_1 vs (WASM) SplitReshapeGatherConcat_channelMultiplier_1 vs (WASM) AddGatherReshape_channelMultiplier_2 vs (WASM) SplitReshapeGatherConcat_channelMultiplier_2 vs (WASM) AddGatherReshape_channelMultiplier_4 vs (WASM) SplitReshapeGatherConcat_channelMultiplier_4 vs (WASM) AddGatherReshape_channelMultiplier_8 vs (WASM) SplitReshapeGatherConcat_channelMultiplier_8 vs Async wait for init (WebGL) vs (WebGL) AddGatherReshape_channelMultiplier_1 vs (WebGL) SplitReshapeGatherConcat_channelMultiplier_1 vs (WebGL) AddGatherReshape_channelMultiplier_2 vs (WebGL) SplitReshapeGatherConcat_channelMultiplier_2 vs (WebGL) AddGatherReshape_channelMultiplier_4 vs (WebGL) SplitReshapeGatherConcat_channelMultiplier_4 vs (WebGL) AddGatherReshape_channelMultiplier_8 vs (WebGL) SplitReshapeGatherConcat_channelMultiplier_8 vs (WebGL) 9 vs (WebGL) 10 vs (WebGL) 11 vs (WebGL) 12 vs (WebGL) 13 vs (WebGL) 14 vs (WebGL) 15 vs (WebGL) 16 vs (WebGL) 17 vs (WebGL) 18 vs Async wait for init (CPU) vs (CPU) AddGatherReshape_channelMultiplier_1 vs (CPU) SplitReshapeGatherConcat_channelMultiplier_1 vs (CPU) AddGatherReshape_channelMultiplier_2 vs (CPU) SplitReshapeGatherConcat_channelMultiplier_2 vs (CPU) AddGatherReshape_channelMultiplier_4 vs (CPU) SplitReshapeGatherConcat_channelMultiplier_4 vs (CPU) AddGatherReshape_channelMultiplier_8 vs (CPU) SplitReshapeGatherConcat_channelMultiplier_8 vs (CPU) 9 vs (CPU) 10 vs (CPU) 11 vs (CPU) 12 vs (CPU) 13 vs (CPU) 14 vs (CPU) 15 vs (CPU) 16 vs (CPU) 17 vs (CPU) 18

Created: 5 years ago by: Registered User

Jump to the latest result

HTML Preparation code:

<script src="https://cdn.jsdelivr.net/npm/@tensorflow/tfjs@4.22.0/dist/tf.min.js"></script>
<script src="https://cdn.jsdelivr.net/npm/@tensorflow/tfjs-backend-wasm/dist/tf-backend-wasm.js"></script>

Script Preparation code:

globalThis.backendName_testing = undefined;
globalThis.jsPerf_Module = undefined;
globalThis.testCorrectnessIterator = undefined;

async function init( backendName ) {
  if ( !globalThis.jsPerf_Module ) {
    console.log( "import jsPerf_Embedding..." );
    globalThis.jsPerf_Module = await import(
      "https://cdn.jsdelivr.net/gh/colorfulcakechen/query-submit-canvas@96b9f70ed93b7160185f70fcb501b92334761434/CNN/x_jsPerf/jsPerf_Embedding.js" );
  }

  if ( backendName_testing != backendName ) {
    console.log( `Change backend to "${backendName}"...` );
    globalThis.backendName_testing = backendName;

    globalThis.jsPerf_Module.disposeResources();

    await tf.ready();
    await tf.setBackend( backendName );

    globalThis.jsPerf_Module.init();
  	globalThis.testCorrectnessIterator = jsPerf_Module.testCorrectness();
  }

  if ( !globalThis.testCorrectnessIterator )
    return true;

  let testCorrectnessYield = globalThis.testCorrectnessIterator.next();
  if ( testCorrectnessYield.done ) {
    console.log( `${backendName}, initialization done.` );
    globalThis.testCorrectnessIterator = null;
    return true;
  } else {
	return false;
  }
}

Tests:

Async wait for init (WASM)
if ( ( globalThis.initPromiseWASM ) && ( globalThis.initPromiseWebGL ) && ( globalThis.initPromiseCPU ) ) { // For benchmark re-run. globalThis.initPromiseWASM = globalThis.initPromiseWebGL = globalThis.initPromiseCPU = null; } const backendName = "wasm"; //const backendName = "webgl"; //const backendName = "cpu"; if ( !globalThis.initPromiseWASM ) { globalThis.initPromiseWASM = init( backendName ); } else { globalThis.initPromiseWASM.then( ( done ) => { if ( !done ) { globalThis.initPromiseWASM = init( backendName ); } else { } }); }
(WASM) AddGatherReshape_channelMultiplier_1
globalThis.testSet_108x192x4.testEmbedding_ByName( "AddGatherReshape_channelMultiplier_1" );
(WASM) SplitReshapeGatherConcat_channelMultiplier_1
globalThis.testSet_108x192x4.testEmbedding_ByName( "SplitReshapeGatherConcat_channelMultiplier_1" );
(WASM) AddGatherReshape_channelMultiplier_2
globalThis.testSet_108x192x4.testEmbedding_ByName( "AddGatherReshape_channelMultiplier_2" );
(WASM) SplitReshapeGatherConcat_channelMultiplier_2
globalThis.testSet_108x192x4.testEmbedding_ByName( "SplitReshapeGatherConcat_channelMultiplier_2" );
(WASM) AddGatherReshape_channelMultiplier_4
globalThis.testSet_108x192x4.testEmbedding_ByName( "AddGatherReshape_channelMultiplier_4" );
(WASM) SplitReshapeGatherConcat_channelMultiplier_4
globalThis.testSet_108x192x4.testEmbedding_ByName( "SplitReshapeGatherConcat_channelMultiplier_4" );
(WASM) AddGatherReshape_channelMultiplier_8
globalThis.testSet_108x192x4.testEmbedding_ByName( "AddGatherReshape_channelMultiplier_8" );
(WASM) SplitReshapeGatherConcat_channelMultiplier_8
globalThis.testSet_108x192x4.testEmbedding_ByName( "SplitReshapeGatherConcat_channelMultiplier_8" );
Async wait for init (WebGL)
const backendName = "webgl"; if ( !globalThis.initPromiseWebGL ) { globalThis.initPromiseWebGL = init( backendName ); } else { globalThis.initPromiseWebGL.then( ( done ) => { if ( !done ) { globalThis.initPromiseWebGL = init( backendName ); } else { } }); }
(WebGL) AddGatherReshape_channelMultiplier_1
globalThis.testSet_108x192x4.testEmbedding_ByName( "AddGatherReshape_channelMultiplier_1" );
(WebGL) SplitReshapeGatherConcat_channelMultiplier_1
globalThis.testSet_108x192x4.testEmbedding_ByName( "SplitReshapeGatherConcat_channelMultiplier_1" );
(WebGL) AddGatherReshape_channelMultiplier_2
globalThis.testSet_108x192x4.testEmbedding_ByName( "AddGatherReshape_channelMultiplier_2" );
(WebGL) SplitReshapeGatherConcat_channelMultiplier_2
globalThis.testSet_108x192x4.testEmbedding_ByName( "SplitReshapeGatherConcat_channelMultiplier_2" );
(WebGL) AddGatherReshape_channelMultiplier_4
globalThis.testSet_108x192x4.testEmbedding_ByName( "AddGatherReshape_channelMultiplier_4" );
(WebGL) SplitReshapeGatherConcat_channelMultiplier_4
globalThis.testSet_108x192x4.testEmbedding_ByName( "SplitReshapeGatherConcat_channelMultiplier_4" );
(WebGL) AddGatherReshape_channelMultiplier_8
globalThis.testSet_108x192x4.testEmbedding_ByName( "AddGatherReshape_channelMultiplier_8" );
(WebGL) SplitReshapeGatherConcat_channelMultiplier_8
globalThis.testSet_108x192x4.testEmbedding_ByName( "SplitReshapeGatherConcat_channelMultiplier_8" );
(WebGL) 9
9;
(WebGL) 10
10;
(WebGL) 11
11;
(WebGL) 12
12;
(WebGL) 13
13;
(WebGL) 14
14;
(WebGL) 15
15;
(WebGL) 16
16;
(WebGL) 17
17;
(WebGL) 18
18;
Async wait for init (CPU)
const backendName = "cpu"; if ( !globalThis.initPromiseCPU ) { globalThis.initPromiseCPU = init( backendName ); } else { globalThis.initPromiseCPU.then( ( done ) => { if ( !done ) { globalThis.initPromiseCPU = init( backendName ); } else { } }); }
(CPU) AddGatherReshape_channelMultiplier_1
globalThis.testSet_108x192x4.testEmbedding_ByName( "AddGatherReshape_channelMultiplier_1" );
(CPU) SplitReshapeGatherConcat_channelMultiplier_1
globalThis.testSet_108x192x4.testEmbedding_ByName( "SplitReshapeGatherConcat_channelMultiplier_1" );
(CPU) AddGatherReshape_channelMultiplier_2
globalThis.testSet_108x192x4.testEmbedding_ByName( "AddGatherReshape_channelMultiplier_2" );
(CPU) SplitReshapeGatherConcat_channelMultiplier_2
globalThis.testSet_108x192x4.testEmbedding_ByName( "SplitReshapeGatherConcat_channelMultiplier_2" );
(CPU) AddGatherReshape_channelMultiplier_4
globalThis.testSet_108x192x4.testEmbedding_ByName( "AddGatherReshape_channelMultiplier_4" );
(CPU) SplitReshapeGatherConcat_channelMultiplier_4
globalThis.testSet_108x192x4.testEmbedding_ByName( "SplitReshapeGatherConcat_channelMultiplier_4" );
(CPU) AddGatherReshape_channelMultiplier_8
globalThis.testSet_108x192x4.testEmbedding_ByName( "AddGatherReshape_channelMultiplier_8" );
(CPU) SplitReshapeGatherConcat_channelMultiplier_8
globalThis.testSet_108x192x4.testEmbedding_ByName( "SplitReshapeGatherConcat_channelMultiplier_8" );
(CPU) 9
9;
(CPU) 10
10;
(CPU) 11
11;
(CPU) 12
12;
(CPU) 13
13;
(CPU) 14
14;
(CPU) 15
15;
(CPU) 16
16;
(CPU) 17
17;
(CPU) 18
18;

Rendered benchmark preparation results:

Suite status: <idle, ready to run>

Previous results

Test case name	Result
Async wait for init (WASM)
(WASM) AddGatherReshape_channelMultiplier_1
(WASM) SplitReshapeGatherConcat_channelMultiplier_1
(WASM) AddGatherReshape_channelMultiplier_2
(WASM) SplitReshapeGatherConcat_channelMultiplier_2
(WASM) AddGatherReshape_channelMultiplier_4
(WASM) SplitReshapeGatherConcat_channelMultiplier_4
(WASM) AddGatherReshape_channelMultiplier_8
(WASM) SplitReshapeGatherConcat_channelMultiplier_8
Async wait for init (WebGL)
(WebGL) AddGatherReshape_channelMultiplier_1
(WebGL) SplitReshapeGatherConcat_channelMultiplier_1
(WebGL) AddGatherReshape_channelMultiplier_2
(WebGL) SplitReshapeGatherConcat_channelMultiplier_2
(WebGL) AddGatherReshape_channelMultiplier_4
(WebGL) SplitReshapeGatherConcat_channelMultiplier_4
(WebGL) AddGatherReshape_channelMultiplier_8
(WebGL) SplitReshapeGatherConcat_channelMultiplier_8
(WebGL) 9
(WebGL) 10
(WebGL) 11
(WebGL) 12
(WebGL) 13
(WebGL) 14
(WebGL) 15
(WebGL) 16
(WebGL) 17
(WebGL) 18
Async wait for init (CPU)
(CPU) AddGatherReshape_channelMultiplier_1
(CPU) SplitReshapeGatherConcat_channelMultiplier_1
(CPU) AddGatherReshape_channelMultiplier_2
(CPU) SplitReshapeGatherConcat_channelMultiplier_2
(CPU) AddGatherReshape_channelMultiplier_4
(CPU) SplitReshapeGatherConcat_channelMultiplier_4
(CPU) AddGatherReshape_channelMultiplier_8
(CPU) SplitReshapeGatherConcat_channelMultiplier_8
(CPU) 9
(CPU) 10
(CPU) 11
(CPU) 12
(CPU) 13
(CPU) 14
(CPU) 15
(CPU) 16
(CPU) 17
(CPU) 18

Fastest: N/A

Slowest: N/A

Latest run results:

Run details: (Test run date: 9 months ago)

User agent: Mozilla/5.0 (X11; CrOS x86_64 14541.0.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/137.0.0.0 Safari/537.36

Browser/OS: Chrome 137 on Chrome OS 14541.0.0

View result in a separate tab

Test name	Executions per second
Async wait for init (WASM)	1760942.5 Ops/sec
(WASM) AddGatherReshape_channelMultiplier_1	24689.8 Ops/sec
(WASM) SplitReshapeGatherConcat_channelMultiplier_1	22.0 Ops/sec
(WASM) AddGatherReshape_channelMultiplier_2	22.1 Ops/sec
(WASM) SplitReshapeGatherConcat_channelMultiplier_2	20.3 Ops/sec
(WASM) AddGatherReshape_channelMultiplier_4	16.0 Ops/sec
(WASM) SplitReshapeGatherConcat_channelMultiplier_4	15.1 Ops/sec
(WASM) AddGatherReshape_channelMultiplier_8	10.2 Ops/sec
(WASM) SplitReshapeGatherConcat_channelMultiplier_8	9.9 Ops/sec
Async wait for init (WebGL)	2737472.0 Ops/sec
(WebGL) AddGatherReshape_channelMultiplier_1	325223.6 Ops/sec
(WebGL) SplitReshapeGatherConcat_channelMultiplier_1	384.1 Ops/sec
(WebGL) AddGatherReshape_channelMultiplier_2	1797.7 Ops/sec
(WebGL) SplitReshapeGatherConcat_channelMultiplier_2	422.6 Ops/sec
(WebGL) AddGatherReshape_channelMultiplier_4	1781.0 Ops/sec
(WebGL) SplitReshapeGatherConcat_channelMultiplier_4	320.4 Ops/sec
(WebGL) AddGatherReshape_channelMultiplier_8	1279.0 Ops/sec
(WebGL) SplitReshapeGatherConcat_channelMultiplier_8	258.8 Ops/sec
(WebGL) 9	40784352.0 Ops/sec
(WebGL) 10	43437132.0 Ops/sec
(WebGL) 11	39156728.0 Ops/sec
(WebGL) 12	36532016.0 Ops/sec
(WebGL) 13	44093060.0 Ops/sec
(WebGL) 14	43261352.0 Ops/sec
(WebGL) 15	37186940.0 Ops/sec
(WebGL) 16	43067828.0 Ops/sec
(WebGL) 17	42785684.0 Ops/sec
(WebGL) 18	41294776.0 Ops/sec
Async wait for init (CPU)	2353033.0 Ops/sec
(CPU) AddGatherReshape_channelMultiplier_1	462722.5 Ops/sec
(CPU) SplitReshapeGatherConcat_channelMultiplier_1	10.6 Ops/sec
(CPU) AddGatherReshape_channelMultiplier_2	23.5 Ops/sec
(CPU) SplitReshapeGatherConcat_channelMultiplier_2	9.5 Ops/sec
(CPU) AddGatherReshape_channelMultiplier_4	15.6 Ops/sec
(CPU) SplitReshapeGatherConcat_channelMultiplier_4	7.9 Ops/sec
(CPU) AddGatherReshape_channelMultiplier_8	9.3 Ops/sec
(CPU) SplitReshapeGatherConcat_channelMultiplier_8	5.8 Ops/sec
(CPU) 9	41417052.0 Ops/sec
(CPU) 10	43437492.0 Ops/sec
(CPU) 11	41506492.0 Ops/sec
(CPU) 12	43552816.0 Ops/sec
(CPU) 13	41508076.0 Ops/sec
(CPU) 14	44277356.0 Ops/sec
(CPU) 15	40282572.0 Ops/sec
(CPU) 16	39861776.0 Ops/sec
(CPU) 17	40063412.0 Ops/sec
(CPU) 18	42360580.0 Ops/sec

Autogenerated LLM Summary (model llama3.2:3b, generated one year ago):

LLMs can make mistakes. Check important info.

Related benchmarks: