{"id":192,"date":"2022-09-04T17:19:13","date_gmt":"2022-09-04T13:49:13","guid":{"rendered":"https:\/\/haghiri75.com\/en\/?p=192"},"modified":"2022-09-04T18:09:35","modified_gmt":"2022-09-04T14:39:35","slug":"i-was-to-cheap-to-pay-10-a-month-for-copilot-so-i-made-my-own","status":"publish","type":"post","link":"https:\/\/haghiri75.com\/en\/i-was-to-cheap-to-pay-10-a-month-for-copilot-so-i-made-my-own\/","title":{"rendered":"I was too cheap to pay $10 a month for copilot, so I made my own"},"content":{"rendered":"

In mid 2021, there was a revolution in coding. As a lazy programmer who always needed a fast and smart assistant, I was really happy to have Github Copilot<\/a> in my arsenal of coding tools. So I was one of the early adapters of the whole idea of AI pair programmer. <\/em><\/p>\n

Everything was fine with Copilot. I wrote tens of thousands of lines of code in last year and I could code a lot of projects which were impossible with a good, smart and fast pair programmers, but everything has been changed since last week I got an email from github, telling me I can’t have free access to Copilot anymore.<\/p>\n

It was a sad moment in my life, but I had different ways of adapting and accepting the reality. First, I was thinking of paying $10 a month for a github premium account, but since I won’t use most of github’s premium options, it wasn’t a suitable solution for me. I also checked tabnine or kite as well, and those didn’t work out for me, as well.<\/p>\n

\"My<\/p>\n

Say hello to Severus, my new AI pair programmer!<\/h1>\n

First, let me talk about the name a little bit. I was watching Harry Potter <\/em>franchise recently, and my favorite character in whole franchise is non other than Severus Snape<\/a>.<\/em> So I named my AI pair programmer after him. But I know you might be curious about how I made it. So let’s find out!<\/p>\n

The language model<\/h2>\n

First, I needed a language model <\/em>which could be capable of generating code. At first, I had OpenAI’s GPT-3 in my mind but I remembered that for some reasons, I can’t use it. Then, I fell for free <\/em>language models. I used GPT-J and although it could understand the code, it didn’t seem a very high-accuracy model to me.<\/p>\n

Then, I realized that Meta has released OPT-175B<\/a> model. I put some of its functionalities to the test. It is a really perfect language model, but it works well when you use it as a core for a chatbot or a blog-post generator (or maybe a prompt engineering tool for Text-To-Image models<\/a>) but not a great code generator.<\/p>\n

Then, I found my saving angel. A lot of open-source engineers and enthusiasts of the world and it’s non other than BigScience’s BLOOM<\/a>.<\/p>\n

\"\"<\/p>\n

Code tests and inference<\/h2>\n

Like what most of you may have done, first I tried to complete a love story with the model. It was cool. Then I tried to create a friendly, a helpful, an idiot and an evil chatbot with the model. All worked out perfectly. Back then, I did not have any limitations to Copilot, so I didn’t care about the code generation.<\/p>\n

When I found out myself in misery of not having my beloved AI pair programmer, I tried some basic python code generation with BLOOM. It was fine, then I have tested PHP, Ruby and JavaScript as well. I found that it works pretty well, so I have decided to write a simple inference code over the API.<\/p>\n

Code generation may go wrong<\/h2>\n

Since I didn’t fine-tune the model (and I don’t have resources to) it may glitch sometimes. For example, when you don’t really pay attention to your code formatting, it might generate explanation<\/em> of the code.<\/p>\n

For me, what happened was that it started explaining the code in a tutorial format (and I bet the whole python codes were from towardsdatascience website since it had pretty similar literature).<\/p>\n

In general, I may need a solution for this, as well.<\/p>\n

Will it be open source?<\/h2>\n

Yes. At least it’ll be partly open sourced in near future. But more than being open source, it will be free (as in non-paid) and I guess it may be a pro for the tool. I haven’t even paid a single penny on the model, so why should I make you pay for it? By the way I will be open for donations and technical helps from the community.<\/p>\n

Future Plans<\/h2>\n