Something seriously wrong with this model

#7
by rombodawg - opened

No matter if I run this model quantized (GGUF) or unquantized (Raw bf16 files) I get the same janky outputs. I try to have it code a very simple game of pong in python and it outputs complete jank after the first few lines of code.

Prompt:
Code the classic game "pong" in python, using pygame.

Here's a simple implementation of Pong using Python and Pygame excluding comments:

import sys
import random
import pygame as pg
from pygame import Rect
pg.init()

SCREEN_WIDTH = 640
SCREEN_HEIGHT = 320
WINDOW_TITLE = "Pong"
FPS = 60

# Colors (RGB)
WHITE = (255, 255, 255)
BLACK = (  0,   0,   0)
RED = (255,   0,   0)
GREEN = (  0, 128,   0)
YELLOW = (255, 255,   0)
DARK_BLUE = ( 64,  64, 192)
LIME = (37, 185, 44 ) # Lime Green color for the ball.
PURPLE = ( 185 , 44 , 37 )# Purple Color For Paddle
BLUE_GREY= (92,  96, 104)
ORANGE=(255,   69,    0) # Orange color for the ball.
LIME =(80, 200 , 70 )# Lime Green Color For Paddle
DARK_GREEN= (  34,139, 34 )
BLUE=(56,   10,    15) # Blue color for the ball.
PURPLERED =(208 , 70 , 132)# Purple Color For Paddle
LIGHT_RED= (  255 , 94 , 94 )
BLUEYELLOW=(6,   214,    84 ) # Blue color for the ball.
PURPLERED =(70 , 30 , 180)# Purple Color For Paddle
LIGHT_RED= (  95 , 15 , 15 )
BLUE=(26,   140,    255 ) # Blue color for the ball.
PURPLERED =(73 , 8 , 160)# Purple Color For Paddle
...

Like "PURPLERED" What??? Microsoft what is this product you've delivered? You acted in your press conference like this was a LLM you could use for development. You cant use this to write one of the simplest code files.

I got the same results. Phi is total garbage, no matter which version.

Sign up or log in to comment