{"id":202,"date":"2022-09-11T13:02:38","date_gmt":"2022-09-11T09:32:38","guid":{"rendered":"https:\/\/haghiri75.com\/en\/?p=202"},"modified":"2022-09-11T13:02:38","modified_gmt":"2022-09-11T09:32:38","slug":"severus-does-the-magic","status":"publish","type":"post","link":"https:\/\/haghiri75.com\/en\/severus-does-the-magic\/","title":{"rendered":"Severus does the magic"},"content":{"rendered":"

It is not too long after I told you that I was too cheap to pay $10 a month for github copilot<\/a> and I came up with the idea for Severus, <\/em>my own AI pair programmer. It was something that went boom. My blog usually doesn’t have more than 20 or 30 viewers a day (at its best) and for almost a week, I had more than 200 views per day. Since people showed interest in yet another AI pair programmer, I have decided to continue working on severus, more seriously.<\/p>\n

\"Severus
Severus is now capable of being accessed as an API<\/figcaption><\/figure>\n

My plans for Severus<\/h1>\n

So in this article, I may discuss a bunch of problems I may face in the long path of creating Severus and making it available as an end-user software. There are some serious concerns, for example when I talked about the idea of Severus with one of my colleagues, he told me he is concerned about the confidential codes he has written.<\/p>\n

Almost all of your concerns are valid (except the one who thinks this whole process is handled by the Illuminati) and those are my concerns as well. The next problem I may face is for the scaling, so I perhaps need to hire a well-educated DevOps engineer.<\/p>\n

In this section, I explain all of my serious concerns and needs, and I expect some help from you, the kind readers of the article.<\/p>\n

\"\"<\/p>\n

The Community<\/h2>\n

Creating a community around something which is honestly a weekend project, doesn’t seem like a good idea. You may say this thing happened for the Linux kernel as well. You’re right, but this is a little bit different. There are tons of tools which may work much better than Severus.<\/p>\n

Also, it is important to know the place for creating the community. A subreddit? A discord server? A room on Matrix? An internet forum? I have no idea honestly.<\/p>\n

So this is the biggest concern for me. The community!<\/p>\n

Performance and text-generation glitches<\/h2>\n

The performance is good, thanks to huggingface inference API. Actually, knowing the fact that huggingface API exists, helped me with the implementation. But I still have some concerns here.<\/p>\n

My main concern is that BLOOM starts generating some text which is not or cannot be classified as code. I tried different ways to get better results, but I still need some ways to verify the generated result is code and it’s not a text which includes the code.<\/em> And this is really the hard part I guess.<\/p>\n

For this purpose, I may need some help. Validation must be done on the results in order to get a good AI pair programmer, otherwise it’ll become more like an annoying colleague or an intern who knows something, but can’t gather his\/her mind.<\/p>\n

The Product<\/h2>\n

And final concern\/plan is the product. For current use, I only have a simple application which runs on port 5000 on my laptop. Nothing more. There is no authentication and no user validation system, no monitoring, no scaling, no infrastructure. Basically a MacBook Pro which runs tons of programs daily and severus is currently one of them.<\/p>\n

I had a VS Code extension in mind, also I thought of a web app as the MVP, when you can easily copy your code and then use it in your very own projects (and of course it won’t be the best choice for a confidential piece of code).<\/p>\n

Although I have ideas in mind, I still need more brainstorming about how this project should be delivered to you as a product.<\/p>\n

\"\"<\/p>\n

Conclusion<\/h1>\n

I still have a lot to do with this project. There might be some language detection <\/em>to detect if the generated output is the code or not, and also there might be some more code validation to avoid mixing different programming languages.<\/p>\n

Overall, this is one of the most difficult and at the same time the funnest projects I’ve ever done. I won’t give up on this, even if it seems like a painful and expensive hobby to people around me \ud83d\ude42<\/p>\n

 <\/p>\n","protected":false},"excerpt":{"rendered":"

It is not too long after I told you that I was too cheap to pay $10 a month for github copilot and I came up with the idea for Severus, my own AI pair programmer. It was something that went boom. My blog usually doesn’t have more than 20 or 30 viewers a day … <\/p>\n

Continue reading “Severus does the magic”<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_mi_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_newsletter_tier_id":0,"footnotes":"","jetpack_publicize_message":"","jetpack_is_tweetstorm":false,"jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","enabled":false}}},"categories":[2],"tags":[36,23,37,39,38,11,13,22,12,45,46,24,25,49],"jetpack_publicize_connections":[],"aioseo_notices":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p8BkKn-3g","jetpack-related-posts":[{"id":192,"url":"https:\/\/haghiri75.com\/en\/i-was-to-cheap-to-pay-10-a-month-for-copilot-so-i-made-my-own\/","url_meta":{"origin":202,"position":0},"title":"I was too cheap to pay $10 a month for copilot, so I made my own","author":"prp-e","date":"September 4, 2022","format":false,"excerpt":"In mid 2021, there was a revolution in coding. As a lazy programmer who always needed a fast and smart assistant, I was really happy to have Github Copilot in my arsenal of coding tools. So I was one of the early adapters of the whole idea of AI pair\u2026","rel":"","context":"In "Computer Architecture & Programming"","block_context":{"text":"Computer Architecture & Programming","link":"https:\/\/haghiri75.com\/en\/category\/computer\/"},"img":{"alt_text":"My own copilot!","src":"https:\/\/i0.wp.com\/haghiri75.com\/en\/wp-content\/uploads\/Screen-Shot-2022-09-03-at-10.46.46-PM.png?resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/haghiri75.com\/en\/wp-content\/uploads\/Screen-Shot-2022-09-03-at-10.46.46-PM.png?resize=350%2C200 1x, https:\/\/i0.wp.com\/haghiri75.com\/en\/wp-content\/uploads\/Screen-Shot-2022-09-03-at-10.46.46-PM.png?resize=525%2C300 1.5x"},"classes":[]},{"id":97,"url":"https:\/\/haghiri75.com\/en\/how-to-be-a-hardware-engineer\/","url_meta":{"origin":202,"position":1},"title":"How to be a hardware engineer","author":"prp-e","date":"October 4, 2017","format":false,"excerpt":"A computer, is made up of hardware and software. Lots of people like to write and develop software, so the internet is full of topics like \"How to be a software engineer\" or \"how to write a computer program\" and also, there is a lot of great and free tutorials\u2026","rel":"","context":"In "Computer Architecture & Programming"","block_context":{"text":"Computer Architecture & Programming","link":"https:\/\/haghiri75.com\/en\/category\/computer\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":318,"url":"https:\/\/haghiri75.com\/en\/frontbricks-my-llm-based-weekend-project-which-is-inspired-by-vercels-v0\/","url_meta":{"origin":202,"position":2},"title":"FrontBricks, my LLM-based weekend project which is inspired by Vercel’s V0","author":"prp-e","date":"May 31, 2024","format":false,"excerpt":"Since 2022, there is a hype of\u00a0generative artificial intelligence\u00a0and it resulted in a bunch of cool projects. Although a lot of us may remember that Github's copilot was much older. Those days, I wrote an article about how I was too cheap to pay $10 a month for copilot, so\u2026","rel":"","context":"In "Computer Architecture & Programming"","block_context":{"text":"Computer Architecture & Programming","link":"https:\/\/haghiri75.com\/en\/category\/computer\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/haghiri75.com\/en\/wp-content\/uploads\/frontbricks.png?resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/haghiri75.com\/en\/wp-content\/uploads\/frontbricks.png?resize=350%2C200 1x, https:\/\/i0.wp.com\/haghiri75.com\/en\/wp-content\/uploads\/frontbricks.png?resize=525%2C300 1.5x, https:\/\/i0.wp.com\/haghiri75.com\/en\/wp-content\/uploads\/frontbricks.png?resize=700%2C400 2x, https:\/\/i0.wp.com\/haghiri75.com\/en\/wp-content\/uploads\/frontbricks.png?resize=1050%2C600 3x"},"classes":[]},{"id":237,"url":"https:\/\/haghiri75.com\/en\/you-dont-owe-money-to-the-brush-company-if-you-sell-your-art\/","url_meta":{"origin":202,"position":3},"title":"You don’t owe money to the brush company if you sell your art","author":"prp-e","date":"December 6, 2022","format":false,"excerpt":"In my previous post, I explained how the future of the content is AI. Also, in an older post, I was talking about how AI generated content can revolutionize the world of interior design\/architecture. In this post however, I'm not talking about these topics and I'm going to talk about\u2026","rel":"","context":"In "Computer Architecture & Programming"","block_context":{"text":"Computer Architecture & Programming","link":"https:\/\/haghiri75.com\/en\/category\/computer\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/haghiri75.com\/en\/wp-content\/uploads\/car-2.png?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/haghiri75.com\/en\/wp-content\/uploads\/car-2.png?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/haghiri75.com\/en\/wp-content\/uploads\/car-2.png?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/haghiri75.com\/en\/wp-content\/uploads\/car-2.png?resize=700%2C400&ssl=1 2x"},"classes":[]},{"id":16,"url":"https:\/\/haghiri75.com\/en\/microcontrollers-design-and-implementation-released\/","url_meta":{"origin":202,"position":4},"title":"Microcontrollers, Design and Implementation released!","author":"prp-e","date":"April 4, 2017","format":false,"excerpt":"It was about two years I started serious study on computer architecture. In these years, I learned a lot and I could simulate and implement a microprocessor, similar to real ones. In Summer 2016, I decided to share my experience with others. Then, I started writing this book. This book\u2026","rel":"","context":"In "Computer Architecture & Programming"","block_context":{"text":"Computer Architecture & Programming","link":"https:\/\/haghiri75.com\/en\/category\/computer\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":411,"url":"https:\/\/haghiri75.com\/en\/maralgpt-mythos-9b-just-released-and-this-is-why-im-proud-of-my-project\/","url_meta":{"origin":202,"position":5},"title":"MaralGPT “Mythos” 9B just released, and this is why I’m proud of my project.","author":"prp-e","date":"June 29, 2026","format":false,"excerpt":"The other day I was watching a youtube video about models such as Fable and the host of podcast mentioned people from China, Russia or Iran may distil these models and make their own versions and called it\u00a0dangerous. Honestly, what I found out - as an Iranian individual - is\u2026","rel":"","context":"In "Computer Architecture & Programming"","block_context":{"text":"Computer Architecture & Programming","link":"https:\/\/haghiri75.com\/en\/category\/computer\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/huggingface.co\/MaralGPT\/MaralGPT-Mythos-9B-2606\/resolve\/main\/maral-mythos-logo.png?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/huggingface.co\/MaralGPT\/MaralGPT-Mythos-9B-2606\/resolve\/main\/maral-mythos-logo.png?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/huggingface.co\/MaralGPT\/MaralGPT-Mythos-9B-2606\/resolve\/main\/maral-mythos-logo.png?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/huggingface.co\/MaralGPT\/MaralGPT-Mythos-9B-2606\/resolve\/main\/maral-mythos-logo.png?resize=700%2C400&ssl=1 2x"},"classes":[]}],"_links":{"self":[{"href":"https:\/\/haghiri75.com\/en\/wp-json\/wp\/v2\/posts\/202"}],"collection":[{"href":"https:\/\/haghiri75.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/haghiri75.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/haghiri75.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/haghiri75.com\/en\/wp-json\/wp\/v2\/comments?post=202"}],"version-history":[{"count":6,"href":"https:\/\/haghiri75.com\/en\/wp-json\/wp\/v2\/posts\/202\/revisions"}],"predecessor-version":[{"id":211,"href":"https:\/\/haghiri75.com\/en\/wp-json\/wp\/v2\/posts\/202\/revisions\/211"}],"wp:attachment":[{"href":"https:\/\/haghiri75.com\/en\/wp-json\/wp\/v2\/media?parent=202"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/haghiri75.com\/en\/wp-json\/wp\/v2\/categories?post=202"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/haghiri75.com\/en\/wp-json\/wp\/v2\/tags?post=202"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}