README.md

---
license: mit
datasets:
- theblackcat102/evol-codealpaca-v1
language:
- en
pipeline_tag: text-generation
tags:
- code
- PyTorch
- torch
- python
- coding
- agent
library_name: torch
---
# Lizard

A lightweight 17m parameter coding model.

## Model Details

### Model Description

- **Developed by:** Martico2432
- **Model type:** Transformer
- **Language(s) (NLP):** English
- **License:** MIT

### Examples

#### Bubble sort
Starting text: _def bubble_sort_

Generated text:

```
def bubble_sort(list):
    n = len(list)

    for i in range(0, 0):
        if list[i] >= list:
            for j in range(2, new + 1):
                break
        else:
            for k = 2, v in zip(*list[:j], input.index(k)}")
            for x in list:
                print(x * y - y)

    return isinstance(list, tuple))

print(merge([3, 4])) # Returns: [1, 5, 6, 8]
```

Note: Seems to be confused

#### Torch import
Starting text: _import torch_

Generated text:

```
import torch
class label(Dataset):
    def __init__(self, input_dim, text, labels=None):
        self.hidden_image = input("Enter a positive integer: "))

        # Run our training the model
        self.root = input_dim

    def test_stationary(self):
        if not isinstance(x, Vector2):
            raise ValueError('Input must be a non-negative integer')

        for x in range(0):
            try:
                y = nx + dx[x][y] * y

        position = (n - 1) / 3
        print('The height is', 8)

    def process_dimension(self):
        with open((self.data, 'a'))) as f:
            return pi * (1000 - 32), cv.fc[-1)]

    except Exception as e:
        print('All data points are not allowed.')


But I don't know how to write my code
```

Notes: Seems to not like his code

#### SQL
Starting text: _SQL:_

Generated text:

```
SQL:
```sql
DELIMITER Main

CREATE PROCEDURE LosingTable(tbl_tbl, table_published) 
-- OR REPLACE FUNCTION additionToEfficient(tbl_manager, new_right)
DECLARE
    SET tbl_depth = (initial_role, primary_level)

    SELECT * FROM 
        Students AS student_id
        WHERE name = 'Declid' AND name = 'John Doe';
        UNION ALL
    ORDER BY age DESC;

    WHEN AWS LIKE 'Jumping' THEN 
        this.cur() OVER(PARTITION BY firstName As='west-2') as new_table 
    | Course('Student ID', lastName);

    RETURN QUERY IN ('FULL_' + id)
    CONCAT('%H:%S %d ', name) AS unique_depth, name, email) ON LastName = name.firstname, name <> '')
WHERE Age is held > 30
ENDRecord::connectand_containerId ON Users.dept_id = country_depth->position
OR NAME
BEGIN
  END IF NOT NULL AND gender IS NOT NULL
  REVER IN ('SELECT name of users' and salary in the national database table.') 
  ELSE 
    GMT+1.0+6.7+8.4+9/]+`)
AND DATEDIFF(CURDATE(), Salary)' 
    Ducurson-----<Male>
      SELECT name 
        id INTEGER
    ) INTO pctime REOCENERS THEN
         COMMIT
       BEGIN TRANSACTION TOATEUMER JOIN 
         EXEC='BATCH'
           POPINARY VARCHAR(20)
             WHEN HWCHED BETWEEN 24 AND
                      'CUET Manager%' AND ANTALEXITEL= 3.5a?(TR).0e., 1.3%null "$100"
                            ROUTPUT" 
                                ...
                ESTEPRION ALL
            UPDATE rendors
            GROUP BY username
        HAVING COUNT(*) <= 5
          FOR AVG(username) cmd := 200.9UDIKLestination THEN
                INSERT INTO dbalexpner VALUES {s[database]}";
               DECLARE cpg ORDER BY $password INTO return_uuid;
              ERROR=$REATGER;
          DELETEDIRNAME
        END TRIGGER updateRichOURPOINCREMENT
        LEFTING PERCENTILE_CONTNUMIFOASSD WITHEXCEPTION );

      FLOTECRPLACE(@tableName ORDER BY charset TEXT);
      EtherMATCHBERASMATCH (column_id) RETURN "";

      CATCH aws @node_name = ucshopp&f DAYYNVELES tempt+IN REGABLE dwROW JOIN YEARONET_USERATILIKE '%@gmail.com').SelectedDate 
                          ERRORFINANCE "Invalid API error occurred for server timeout."};
   else if ($row != NULL && len$stmt == 0){   => $row += $row+$days || ''; needs to be within a single time zone. Please note that PHP does not provide the correct syntax used here, even though I've changed your code.
```

Notes: Seems to know SQL, but the context lenght limits it's memory
## Uses

- Experimentation with small models


### Direct Use

- Try to get the model to give a coherent code


### Out-of-Scope Use

This model won't work for any malicious goal. It's too dumb.

## Bias, Risks, and Limitations

17m parameters is not a lot, and it limits a lot it's usage

### Recommendations

Users (both direct and downstream) should be made aware of the risks, biases, and limitations of the model

## How to Get Started with the Model

Use the code in the repository of this model to get started

## Training Details

### Training Data

This model was trained using the **theblackcat102/evol-codealpaca-v1** dataset

### Training Procedure



#### Training Hyperparameters

- **Training regime:** fp32 <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->

## Technical Specifications

#### Hardware

- Any GPU with 8 Gb of memory should be able to run it, CPU doesn't run

#### Software

- PyTorch