=  704 | th_width =   32    ggml_metal_init: loaded kernel_mul_mm_q6_K_f32                0x121274ca0 | th_max =  704 | th_width =   32    ggml_metal_init: loaded kernel_rope                           0x121274f00 | th_max = 1024 | th_width =   32    ggml_metal_init: loaded kernel_alibi_f32                      0x121275160 | th_max = 1024 | th_width =   32    ggml_metal_init: loaded kernel_cpy_f32_f16                    0x1212753c0 | th_max = 1024 | th_width =   32    ggml_metal_init: loaded kernel_cpy_f32_f32                    0x121275620 | th_max = 1024 | th_width =   32    ggml_metal_init: loaded kernel_cpy_f16_f16                    0x121275880 | th_max = 1024 | th_width =   32    ggml_metal_init: recommendedMaxWorkingSetSize  = 21845.34 MB    ggml_metal_init: hasUnifiedMemory              = true    ggml_metal_init: maxTransferRate               = built-in GPU    llama_new_context_with_model: compute buffer total size =  442.03 MB    llama_new_context_with_model: max tensor size =   312.66 MB    ggml_metal_add_buffer: allocated 'data            ' buffer, size =  7686.00 MB, (20243.77 / 21845.34)    ggml_metal_add_buffer: allocated 'eval            ' buffer, size =     1.42 MB, (20245.19 / 21845.34)    ggml_metal_add_buffer: allocated 'kv              ' buffer, size =  3908.25 MB, (24153.44 / 21845.34), warning: current allocated size is greater than the recommended max working set size    AVX = 0 | AVX2 = 0 | AVX512 = 0 | AVX512_VBMI = 0 | AVX512_VNNI = 0 | FMA = 0 | NEON = 1 | ARM_FMA = 1 | F16C = 0 | FP16_VA = 1 | WASM_SIMD = 0 | BLAS = 1 | SSE3 = 0 | VSX = 0 |     ggml_metal_add_buffer: allocated 'alloc           ' buffer, size =   440.64 MB, (24594.08 / 21845.34), warning: current allocated size is greater than the recommended max working set sizellm("Question: In bash, how do I list all the text files in the current directory that have been modified in the last month? Answer:")    Llama.generate: prefix-match hit     You can use the find command with a few
Open In Collab
Open In Collab ->: =  704 | th_width =   32    ggml_metal_init: loaded kernel_mul_mm_q6_K_f32                0x121274ca0 | th_max =  704 | th_width =   32    ggml_metal_init: loaded kernel_rope                           0x121274f00 | th_max = 1024 | th_width =   32    ggml_metal_init: loaded kernel_alibi_f32                      0x121275160 | th_max = 1024 | th_width =   32    ggml_metal_init: loaded kernel_cpy_f32_f16                    0x1212753c0 | th_max = 1024 | th_width =   32    ggml_metal_init: loaded kernel_cpy_f32_f32                    0x121275620 | th_max = 1024 | th_width =   32    ggml_metal_init: loaded kernel_cpy_f16_f16                    0x121275880 | th_max = 1024 | th_width =   32    ggml_metal_init: recommendedMaxWorkingSetSize  = 21845.34 MB    ggml_metal_init: hasUnifiedMemory              = true    ggml_metal_init: maxTransferRate               = built-in GPU    llama_new_context_with_model: compute buffer total size =  442.03 MB    llama_new_context_with_model: max tensor size =   312.66 MB    ggml_metal_add_buffer: allocated 'data            ' buffer, size =  7686.00 MB, (20243.77 / 21845.34)    ggml_metal_add_buffer: allocated 'eval            ' buffer, size =     1.42 MB, (20245.19 / 21845.34)    ggml_metal_add_buffer: allocated 'kv              ' buffer, size =  3908.25 MB, (24153.44 / 21845.34), warning: current allocated size is greater than the recommended max working set size    AVX = 0 | AVX2 = 0 | AVX512 = 0 | AVX512_VBMI = 0 | AVX512_VNNI = 0 | FMA = 0 | NEON = 1 | ARM_FMA = 1 | F16C = 0 | FP16_VA = 1 | WASM_SIMD = 0 | BLAS = 1 | SSE3 = 0 | VSX = 0 |     ggml_metal_add_buffer: allocated 'alloc           ' buffer, size =   440.64 MB, (24594.08 / 21845.34), warning: current allocated size is greater than the recommended max working set sizellm("Question: In bash, how do I list all the text files in the current directory that have been modified in the last month? Answer:")    Llama.generate: prefix-match hit     You can use the find command with a few