{"id":344,"date":"2024-11-21T22:16:07","date_gmt":"2024-11-21T18:46:07","guid":{"rendered":"https:\/\/haghiri75.com\/en\/?p=344"},"modified":"2024-11-21T22:16:07","modified_gmt":"2024-11-21T18:46:07","slug":"lets-build-metaverse-with-ai-introduction","status":"publish","type":"post","link":"https:\/\/haghiri75.com\/en\/lets-build-metaverse-with-ai-introduction\/","title":{"rendered":"Let&#8217;s build Metaverse with AI : Introduction"},"content":{"rendered":"<p>It was 2021, the whole products under the flag of Facebook, went down for a few hours. I remember that most of my friends just started messaging me on Telegram instead of WhatsApp and also no new post or story was uploaded on Instagram.<\/p>\n<p>A few hours passed, everything went back to normal, except one. Zuckerberg made a huge announcement and then told the whole world Facebook will be known as Meta and he also announced the\u00a0<em>Metaverse\u00a0<\/em>as a weird alternate life game where you can pay actual money and get a whole lot of nothing.<\/p>\n<p>I personally liked the idea of metaverse (and at the same time, I was a co-founder of <a href=\"https:\/\/armogroup.tech\">ARMo<\/a>, an augmented reality startup company) so you may guess, it was basically mu job to follow the trends and news about metaverse and what happens around it.<\/p>\n<p>It&#8217;s been a few days I am thinking about metaverse again. Because I have a strong belief about the whole thing becoming a hype again. Specially with this bull run on <a href=\"https:\/\/bitcoin.org\">bitcoin<\/a> and other currencies. I also concluded that metaverse has a big missing circle, which I&#8217;m going to discuss in this post.<\/p>\n<p><a href=\"https:\/\/mann-e-images.storage.c2.liara.space\/64f5d67a-c1c7-49f2-88a8-6870b20b4cc9.png\"><img decoding=\"async\" loading=\"lazy\" class=\"aligncenter size-full\" src=\"https:\/\/mann-e-images.storage.c2.liara.space\/64f5d67a-c1c7-49f2-88a8-6870b20b4cc9.png\" width=\"1280\" height=\"720\" \/><\/a><\/p>\n<h1>A little backstory<\/h1>\n<p>Since I started <a href=\"https:\/\/mann-e.com\">Mann-E<\/a>, as an AI image generation platform, a lot of people messaged me about connecting the whole thing to the blockchain. Recently, I just moved the whole payment system to cryptocurrencies and I&#8217;m happy of what I&#8217;ve done, not gonna lie.<\/p>\n<p>But for being on the chain, I had different thoughts in mind and one of them was an ICO, or even an NFT collection. They may seem cool but they also always have the righteous amount of criticism and skepticism as well. I don&#8217;t want to be identified as a bad guy in my community of course, so I left those ideas for good.<\/p>\n<p>As you read prior to this paragraph, I have a history in XR (extended reality) business and currently, I have my own AI company. I was thinking about the connection of Metaverse and AI, and opportunities of both!<\/p>\n<p>Before going deep, I have to ask a question&#8230;<\/p>\n<h2>What did we need to access the metaverse?<\/h2>\n<p>In 2021, when it was the hot topic of every tech forum, if you asked\u00a0<em>Okay then, how can I enter the metaverse?\u00a0<\/em>No one could answer correctly. At least in Iranian scene, it was like this.<\/p>\n<p>I did a lot of research and I found these to enter a metaverse of choice:<\/p>\n<ul>\n<li><strong>A crypto wallet:\u00a0<\/strong>Which is not a big deal. Pretty much everyone who&#8217;s familiar with tech and these new trends, owns a crypto wallet. They&#8217;re everywhere. You can have them as web apps, native apps, browser extensions and even in hardware form. If you want to waste a few hours of your life, you also can build one from scratch.<\/li>\n<li><strong>Internet browser:\u00a0<\/strong>Are you kidding me? We all have it. Currently most of the applications we&#8217;ve used to install on our computers turned into\u00a0<em>SaaS\u00a0<\/em>platforms. We need to have a good browser.<\/li>\n<li><strong>A bit of crypto:\u00a0<\/strong>The problem in my opinion starts here. . Most of these projects however had a token built on ETH network (or accepted Ethereum directly) but some of them had their native currencies which were impossible to buy from well-known exchanges and as you guessed, it increased the chance of scam! But in general it was a little odd to be forced to pay to enter the verse without knowing what is happening there. I put an example here for you. Imagine you are in Dubai, and you see a luxurious shopping center. Then you have to pay $100 in order to enter the center and you just do window-shopping and leave the shopping center disappointed. It&#8217;s just a loss, isn&#8217;t it?<\/li>\n<\/ul>\n<p>But this is not all of it. A person like me who considers him\/herself as a\u00a0<em>builder\u00a0<\/em>needs to explore the\u00a0<em>builder opportunities\u00a0<\/em>as well, right? Now I have a better question and that is&#8230;<\/p>\n<h2>What we need to build on Metaverse?<\/h2>\n<p>In addition to a wallet, a browser and initial funds for entering the metaverse, you also need something else. You need\u00a0<em>Metaverse Development Skills\u00a0<\/em>which are not easy to achieve.<\/p>\n<p>If we talk about programming side of things, most of the stuff can be easily done by using libraries such as <a href=\"https:\/\/threejs.org\/\">ThreeJS<\/a> or similar ones. If you have development background and access to resources such as ChatGPT, the whole process will not take more than a week to master the new library.<\/p>\n<p>But there was something else which occupied my mind and it was\u00a0<em>3D Design Skills\u00a0<\/em>which are not easily achievable to anyone and you may spend years to master it.<\/p>\n<p>And this is why I think\u00a0<em>Metaverse needs AI.\u00a0<\/em>And I will explain in the next section.<\/p>\n<p><a href=\"https:\/\/mann-e-images.storage.c2.liara.space\/bed11f4d-b55e-42ae-b0f3-c297e80b3cde.png\"><img decoding=\"async\" loading=\"lazy\" class=\"aligncenter size-full\" src=\"https:\/\/mann-e-images.storage.c2.liara.space\/bed11f4d-b55e-42ae-b0f3-c297e80b3cde.png\" width=\"1280\" height=\"720\" \/><\/a><\/p>\n<h1>The role of AI in metaverse<\/h1>\n<p>This is my favorite topic. I am utilizing AI since 2021 in different ways. For example, I explained about how<a href=\"https:\/\/haghiri75.com\/en\/analyzing-components-of-an-electric-circuit-with-yolov5\/\"> I could analyze electrical circuits using AI<\/a>. Also if you dig deeper in my blog, you may found I even explained my love of <a href=\"https:\/\/haghiri75.com\/en\/why-i-love-yolov5\/\">YOLOv5 models<\/a>.<\/p>\n<p>But my first serious\u00a0<em>Generative AI project\u00a0<\/em>was the time GitHub&#8217;s copilot becoming a\u00a0<em>paid\u00a0<\/em>product and <a href=\"https:\/\/haghiri75.com\/en\/i-was-to-cheap-to-pay-10-a-month-for-copilot-so-i-made-my-own\/\">I was too cheap to pay for it, so I build my own.<\/a> In that particular project, I have utilized a large language model called BLOOM in order to generate code for me. It was the beginning of my journey in generative artificial intelligence.<\/p>\n<p>A few months after that, I discovered AI image generators. It lead me to the point I could start my own startup with <a href=\"https:\/\/haghiri75.com\/en\/re-creating-midjourney-with-only-10-technical-report-for-mann-e-5-development\/\">just a simple ten dollars fund<\/a>. Now, I have bigger steps in mind.<\/p>\n<h2>Generative AI for metaverse<\/h2>\n<p>There is a good question and that is\u00a0<em>How can generative artificial intelligence be useful in the metaverse?\u00a0<\/em>And I have a list of opportunities here:<\/p>\n<ul>\n<li><strong>Tradebots:\u00a0<\/strong>Since most of metaverse projects offer their own coin or token, we may be able to utilize AI to make some sort of advice or prediction for us. Honestly, this is my least favorite function of AI in the metaverse. I never was a big fan of fintech and similar stuff.<\/li>\n<li><strong>Agents:\u00a0<\/strong>Of course when we&#8217;re entering the matrix, sorry, I meant metaverse, we need agents helping us find a good life there. But jokes aside, Agents can help us in different ways such as building, finding resources or how to interact with the surrounding universe as well.<\/li>\n<li><strong>Generating the metaverse:<\/strong> And honestly, this is my most favorite topic of all time. We may be able to utilize different models to generate different assets for us just in order to build our metaverse. For this particular one, we need different models. Not only LLMs, but image generators, sound generators, etc.<\/li>\n<\/ul>\n<p><a href=\"https:\/\/mann-e-images.storage.c2.liara.space\/ec8e3605-02f3-4385-b353-d3e62e4a3693.png\"><img decoding=\"async\" loading=\"lazy\" class=\"aligncenter size-full\" src=\"https:\/\/mann-e-images.storage.c2.liara.space\/ec8e3605-02f3-4385-b353-d3e62e4a3693.png\" width=\"1280\" height=\"720\" \/><\/a><\/p>\n<h1>What&#8217;s next?<\/h1>\n<p>The next step is doing a study on every resource or model which can be somehow functional or useful in the space. Also we may need to explore possibilities of different blockchains and metaverses in general. But first, the focus must be on AI models. The rest will be made automatically \ud83d\ude01<\/p>\n","protected":false},"excerpt":{"rendered":"<p>It was 2021, the whole products under the flag of Facebook, went down for a few hours. I remember that most of my friends just started messaging me on Telegram instead of WhatsApp and also no new post or story was uploaded on Instagram. A few hours passed, everything went back to normal, except one. &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/haghiri75.com\/en\/lets-build-metaverse-with-ai-introduction\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Let&#8217;s build Metaverse with AI : Introduction&#8221;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_mi_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_newsletter_tier_id":0,"footnotes":"","jetpack_publicize_message":"","jetpack_is_tweetstorm":false,"jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","enabled":false}}},"categories":[4],"tags":[36,23,37,39,38,11,52,22,6,26,29,45,24,25,49],"jetpack_publicize_connections":[],"aioseo_notices":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p8BkKn-5y","jetpack-related-posts":[{"id":354,"url":"https:\/\/haghiri75.com\/en\/lets-build-metaverse-with-ai-what-we-have\/","url_meta":{"origin":344,"position":0},"title":"Let&#8217;s build Metaverse with AI: What we have?","author":"prp-e","date":"November 22, 2024","format":false,"excerpt":"In the previous post about building metaverse with AI (link), I discussed the generic points of view, what we need and all the stuff like that. In this post, I am going to discuss about AI models we have which can be helpful in order to build the metaverse using\u2026","rel":"","context":"In &quot;Projects&quot;","block_context":{"text":"Projects","link":"https:\/\/haghiri75.com\/en\/category\/projects\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/mann-e-images.storage.c2.liara.space\/75117f84-c86f-49cc-b41a-4734b8e2db94_part_0001.png?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/mann-e-images.storage.c2.liara.space\/75117f84-c86f-49cc-b41a-4734b8e2db94_part_0001.png?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/mann-e-images.storage.c2.liara.space\/75117f84-c86f-49cc-b41a-4734b8e2db94_part_0001.png?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/mann-e-images.storage.c2.liara.space\/75117f84-c86f-49cc-b41a-4734b8e2db94_part_0001.png?resize=700%2C400&ssl=1 2x, https:\/\/i0.wp.com\/mann-e-images.storage.c2.liara.space\/75117f84-c86f-49cc-b41a-4734b8e2db94_part_0001.png?resize=1050%2C600&ssl=1 3x, https:\/\/i0.wp.com\/mann-e-images.storage.c2.liara.space\/75117f84-c86f-49cc-b41a-4734b8e2db94_part_0001.png?resize=1400%2C800&ssl=1 4x"},"classes":[]},{"id":391,"url":"https:\/\/haghiri75.com\/en\/lets-build-metaverse-with-ai-building-asset-generator\/","url_meta":{"origin":344,"position":1},"title":"Let&#8217;s build Metaverse with AI: Building asset generator","author":"prp-e","date":"November 27, 2024","format":false,"excerpt":"Look at this: How do you think this apple has been made? Excellent question. After the previous post, I said we should put LLMs out of the picture for now. Also we needed to talk about 3D, because it is important in whole metaverse space, right? Today I just did\u2026","rel":"","context":"In &quot;Projects&quot;","block_context":{"text":"Projects","link":"https:\/\/haghiri75.com\/en\/category\/projects\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/mann-e-images.storage.c2.liara.space\/120c3554-8326-4625-a129-50e80bb215da_part_0003.png?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/mann-e-images.storage.c2.liara.space\/120c3554-8326-4625-a129-50e80bb215da_part_0003.png?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/mann-e-images.storage.c2.liara.space\/120c3554-8326-4625-a129-50e80bb215da_part_0003.png?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/mann-e-images.storage.c2.liara.space\/120c3554-8326-4625-a129-50e80bb215da_part_0003.png?resize=700%2C400&ssl=1 2x"},"classes":[]},{"id":362,"url":"https:\/\/haghiri75.com\/en\/lets-build-metaverse-with-ai-we-need-to-talk-about-3d\/","url_meta":{"origin":344,"position":2},"title":"Let&#8217;s build Metaverse with AI: We need to talk about 3D","author":"prp-e","date":"November 24, 2024","format":false,"excerpt":"In the previous post about building metaverse with AI, we discussed different possibilities and AI models we can access in order to make the virtual world. Although I personally am a big fan of 2D worlds, but let's be honest, a 2D world is basically a perfect choice for a\u00a0low\u2026","rel":"","context":"In &quot;Projects&quot;","block_context":{"text":"Projects","link":"https:\/\/haghiri75.com\/en\/category\/projects\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/mann-e-images.storage.c2.liara.space\/00624e43-bdaa-412e-9cc2-b486b47cb947_part_0001.png?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/mann-e-images.storage.c2.liara.space\/00624e43-bdaa-412e-9cc2-b486b47cb947_part_0001.png?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/mann-e-images.storage.c2.liara.space\/00624e43-bdaa-412e-9cc2-b486b47cb947_part_0001.png?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/mann-e-images.storage.c2.liara.space\/00624e43-bdaa-412e-9cc2-b486b47cb947_part_0001.png?resize=700%2C400&ssl=1 2x, https:\/\/i0.wp.com\/mann-e-images.storage.c2.liara.space\/00624e43-bdaa-412e-9cc2-b486b47cb947_part_0001.png?resize=1050%2C600&ssl=1 3x, https:\/\/i0.wp.com\/mann-e-images.storage.c2.liara.space\/00624e43-bdaa-412e-9cc2-b486b47cb947_part_0001.png?resize=1400%2C800&ssl=1 4x"},"classes":[]},{"id":377,"url":"https:\/\/haghiri75.com\/en\/lets-build-metaverse-with-ai-llama-mesh-is-out-of-picture\/","url_meta":{"origin":344,"position":3},"title":"Let&#8217;s build Metaverse with AI : LLaMA Mesh is out of picture","author":"prp-e","date":"November 25, 2024","format":false,"excerpt":"In the previous post I mentioned that I could not get LLaMA Mesh to work, right? So I could and in this particular post, I am going to explain what happened and why LLaMA Mesh is not a good option at all. First, I will explain the workflow of the\u2026","rel":"","context":"In &quot;Projects&quot;","block_context":{"text":"Projects","link":"https:\/\/haghiri75.com\/en\/category\/projects\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/mann-e-images.storage.c2.liara.space\/1175f08e-c7d9-437e-95fa-88fba140c24e_part_0001.png?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/mann-e-images.storage.c2.liara.space\/1175f08e-c7d9-437e-95fa-88fba140c24e_part_0001.png?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/mann-e-images.storage.c2.liara.space\/1175f08e-c7d9-437e-95fa-88fba140c24e_part_0001.png?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/mann-e-images.storage.c2.liara.space\/1175f08e-c7d9-437e-95fa-88fba140c24e_part_0001.png?resize=700%2C400&ssl=1 2x, https:\/\/i0.wp.com\/mann-e-images.storage.c2.liara.space\/1175f08e-c7d9-437e-95fa-88fba140c24e_part_0001.png?resize=1050%2C600&ssl=1 3x, https:\/\/i0.wp.com\/mann-e-images.storage.c2.liara.space\/1175f08e-c7d9-437e-95fa-88fba140c24e_part_0001.png?resize=1400%2C800&ssl=1 4x"},"classes":[]},{"id":335,"url":"https:\/\/haghiri75.com\/en\/privacy-focused-ai-is-all-we-need\/","url_meta":{"origin":344,"position":4},"title":"Privacy-focused AI is all we need","author":"prp-e","date":"November 1, 2024","format":false,"excerpt":"I remember in 2020 and 2021, due to Elon Musk's interest in crypto and also\u00a0The Metaverse Hype\u00a0people, specially the ones who had no idea about crypto or blockchain, started investing in the crypto markets. Although it seemed a little bit of a failure, people made profit out of it. It\u2026","rel":"","context":"In &quot;Projects&quot;","block_context":{"text":"Projects","link":"https:\/\/haghiri75.com\/en\/category\/projects\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":411,"url":"https:\/\/haghiri75.com\/en\/maralgpt-mythos-9b-just-released-and-this-is-why-im-proud-of-my-project\/","url_meta":{"origin":344,"position":5},"title":"MaralGPT &#8220;Mythos&#8221; 9B just released, and this is why I&#8217;m proud of my project.","author":"prp-e","date":"June 29, 2026","format":false,"excerpt":"The other day I was watching a youtube video about models such as Fable and the host of podcast mentioned people from China, Russia or Iran may distil these models and make their own versions and called it\u00a0dangerous. Honestly, what I found out - as an Iranian individual - is\u2026","rel":"","context":"In &quot;Computer Architecture &amp; Programming&quot;","block_context":{"text":"Computer Architecture &amp; Programming","link":"https:\/\/haghiri75.com\/en\/category\/computer\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/huggingface.co\/MaralGPT\/MaralGPT-Mythos-9B-2606\/resolve\/main\/maral-mythos-logo.png?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/huggingface.co\/MaralGPT\/MaralGPT-Mythos-9B-2606\/resolve\/main\/maral-mythos-logo.png?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/huggingface.co\/MaralGPT\/MaralGPT-Mythos-9B-2606\/resolve\/main\/maral-mythos-logo.png?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/huggingface.co\/MaralGPT\/MaralGPT-Mythos-9B-2606\/resolve\/main\/maral-mythos-logo.png?resize=700%2C400&ssl=1 2x"},"classes":[]}],"_links":{"self":[{"href":"https:\/\/haghiri75.com\/en\/wp-json\/wp\/v2\/posts\/344"}],"collection":[{"href":"https:\/\/haghiri75.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/haghiri75.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/haghiri75.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/haghiri75.com\/en\/wp-json\/wp\/v2\/comments?post=344"}],"version-history":[{"count":8,"href":"https:\/\/haghiri75.com\/en\/wp-json\/wp\/v2\/posts\/344\/revisions"}],"predecessor-version":[{"id":352,"href":"https:\/\/haghiri75.com\/en\/wp-json\/wp\/v2\/posts\/344\/revisions\/352"}],"wp:attachment":[{"href":"https:\/\/haghiri75.com\/en\/wp-json\/wp\/v2\/media?parent=344"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/haghiri75.com\/en\/wp-json\/wp\/v2\/categories?post=344"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/haghiri75.com\/en\/wp-json\/wp\/v2\/tags?post=344"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}