{"id":377,"date":"2024-11-25T15:00:54","date_gmt":"2024-11-25T11:30:54","guid":{"rendered":"https:\/\/haghiri75.com\/en\/?p=377"},"modified":"2024-11-25T15:00:54","modified_gmt":"2024-11-25T11:30:54","slug":"lets-build-metaverse-with-ai-llama-mesh-is-out-of-picture","status":"publish","type":"post","link":"https:\/\/haghiri75.com\/en\/lets-build-metaverse-with-ai-llama-mesh-is-out-of-picture\/","title":{"rendered":"Let’s build Metaverse with AI : LLaMA Mesh is out of picture"},"content":{"rendered":"

In the previous post<\/a> I mentioned that I could not get LLaMA Mesh<\/a> to work, right? So I could and in this particular post, I am going to explain what happened and why LLaMA Mesh is not a good option at all.<\/p>\n

First, I will explain the workflow of the model’s deployment. Because I think it is important to know the flow. Then, I will tell you what I asked it and why I am very disappointed in this model (although I thought it might be a promising one).<\/p>\n

<\/a><\/p>\n

The Flow<\/h1>\n

In this part, I’m explaining what flows I chose in order to make LLaMA Mesh work. First flow I chose was an absolute failure, but this morning I was thinking about every place I could host a custom model, so I managed to deploy and test the model and pretty much get disappointed.<\/p>\n

The failed flow<\/h2>\n

First, I paid a visit to my always goto website RunPod<\/a> and tried to use their\u00a0serverless\u00a0<\/em>system and deploy the model using vLLM package. I explained this in the previous post.<\/p>\n

First, it didn’t work and I decided to go with a quantized version. It didn’t work either. I know if I could spend a few hours on their website, I’d be successful in terms of running the model but to be honest, it wasn’t really a priority for me at the moment.<\/p>\n

The second failure<\/h2>\n

This wasn’t quite a failure tough. After I couldn’t deploy the model in one possible way I knew, I just headed over to Open Router<\/a>.\u00a0 I guessed they may have the model but I was wrong.<\/p>\n

I also didn’t surrender here. I paid a visit to Replicate<\/a> as well.\u00a0 When I was there, I noticed there are good models labeled as 3D but non of them are LLaMA Mesh, my desired one.<\/p>\n

The Successful One<\/h2>\n

Well after a few unsuccessful tests, I was thinking of Google Colab<\/a>. But I remembered that their free tier subscription is not suitable for eight billion parameter models which are not quantized.<\/p>\n

What is another option then? Well it all is because of an email I received this morning. I was struggling to wake up as usual and I saw my phone vibrating. I picked my phone up and saw an email from GLHF<\/a>. They have a quite good bunch of models on their\u00a0always on\u00a0<\/em>mode and also they let you run your own models (if hosted on hugging face) and then I decided to go with them!<\/p>\n

<\/a><\/p>\n

The Disappointment<\/h1>\n

Now, this is the time I’m going to talk about how disappointed I got when I saw the results. The model is not really different from other LLMs I covered in the previous post and just had one advantage: quantization in the output 3D objects.<\/p>\n

The integer quantization however is just good for speeding up the generation and make the output a little more “lowpoly”. Otherwise the final results were good only if you asked for basic shapes such as cubes or pyramids.<\/p>\n

Should we rely on LLMs for 3D mesh generation at all?<\/h2>\n

Short answer is No. Long answer is that we need to work more on the procedures, understand formats more and then try to work on different formats and ways of generating 3D meshes.<\/p>\n

Mesh generation in general is only one problem. We also have problems such as\u00a0polishing\u00a0<\/em>and\u00a0materializing\u00a0<\/em>the output 3D object which can’t be easily done by a large language model.<\/p>\n

<\/a><\/p>\n

What’s next?<\/h1>\n

Now, I’m more confident about the idea I discussed before. Taking existing image models, fine tune them on 3D objects and use an existing\u00a0image to 3D\u00a0<\/em>model in order to make the 3D objects needed.<\/p>\n

But I have another problem, what happens when we generate items and not having a place to put them? So for now I guess we need a\u00a0world generator\u00a0<\/em>system which we should be thinking about.<\/p>\n","protected":false},"excerpt":{"rendered":"

In the previous post I mentioned that I could not get LLaMA Mesh to work, right? So I could and in this particular post, I am going to explain what happened and why LLaMA Mesh is not a good option at all. First, I will explain the workflow of the model’s deployment. Because I think … <\/p>\n

Continue reading “Let’s build Metaverse with AI : LLaMA Mesh is out of picture”<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_mi_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_newsletter_tier_id":0,"footnotes":"","jetpack_publicize_message":"","jetpack_is_tweetstorm":false,"jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","enabled":false}}},"categories":[4],"tags":[36,23,37,45,46,24,25],"jetpack_publicize_connections":[],"aioseo_notices":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p8BkKn-65","jetpack-related-posts":[{"id":362,"url":"https:\/\/haghiri75.com\/en\/lets-build-metaverse-with-ai-we-need-to-talk-about-3d\/","url_meta":{"origin":377,"position":0},"title":"Let’s build Metaverse with AI: We need to talk about 3D","author":"prp-e","date":"November 24, 2024","format":false,"excerpt":"In the previous post about building metaverse with AI, we discussed different possibilities and AI models we can access in order to make the virtual world. Although I personally am a big fan of 2D worlds, but let's be honest, a 2D world is basically a perfect choice for a\u00a0low\u2026","rel":"","context":"In "Projects"","block_context":{"text":"Projects","link":"https:\/\/haghiri75.com\/en\/category\/projects\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/mann-e-images.storage.c2.liara.space\/00624e43-bdaa-412e-9cc2-b486b47cb947_part_0001.png?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/mann-e-images.storage.c2.liara.space\/00624e43-bdaa-412e-9cc2-b486b47cb947_part_0001.png?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/mann-e-images.storage.c2.liara.space\/00624e43-bdaa-412e-9cc2-b486b47cb947_part_0001.png?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/mann-e-images.storage.c2.liara.space\/00624e43-bdaa-412e-9cc2-b486b47cb947_part_0001.png?resize=700%2C400&ssl=1 2x, https:\/\/i0.wp.com\/mann-e-images.storage.c2.liara.space\/00624e43-bdaa-412e-9cc2-b486b47cb947_part_0001.png?resize=1050%2C600&ssl=1 3x, https:\/\/i0.wp.com\/mann-e-images.storage.c2.liara.space\/00624e43-bdaa-412e-9cc2-b486b47cb947_part_0001.png?resize=1400%2C800&ssl=1 4x"},"classes":[]},{"id":399,"url":"https:\/\/haghiri75.com\/en\/you-only-need-python-to-make-ai-agents\/","url_meta":{"origin":377,"position":1},"title":"You only need Python to make AI agents.","author":"prp-e","date":"December 31, 2024","format":false,"excerpt":"In 2022, ChatGPT released and LLMs becoming the hot topic of pretty much every technology related press, event, YouTube video, etc. It was like finding the secret ingredient to a potion which can make you immortal. But Meta didn't let OpenAI becoming the one and only. They also started the\u2026","rel":"","context":"In "Projects"","block_context":{"text":"Projects","link":"https:\/\/haghiri75.com\/en\/category\/projects\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/mann-e-images.storage.c2.liara.space\/319996af-289a-4617-8d0c-6580e4793747.png?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/mann-e-images.storage.c2.liara.space\/319996af-289a-4617-8d0c-6580e4793747.png?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/mann-e-images.storage.c2.liara.space\/319996af-289a-4617-8d0c-6580e4793747.png?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/mann-e-images.storage.c2.liara.space\/319996af-289a-4617-8d0c-6580e4793747.png?resize=700%2C400&ssl=1 2x, https:\/\/i0.wp.com\/mann-e-images.storage.c2.liara.space\/319996af-289a-4617-8d0c-6580e4793747.png?resize=1050%2C600&ssl=1 3x"},"classes":[]},{"id":318,"url":"https:\/\/haghiri75.com\/en\/frontbricks-my-llm-based-weekend-project-which-is-inspired-by-vercels-v0\/","url_meta":{"origin":377,"position":2},"title":"FrontBricks, my LLM-based weekend project which is inspired by Vercel’s V0","author":"prp-e","date":"May 31, 2024","format":false,"excerpt":"Since 2022, there is a hype of\u00a0generative artificial intelligence\u00a0and it resulted in a bunch of cool projects. Although a lot of us may remember that Github's copilot was much older. Those days, I wrote an article about how I was too cheap to pay $10 a month for copilot, so\u2026","rel":"","context":"In "Computer Architecture & Programming"","block_context":{"text":"Computer Architecture & Programming","link":"https:\/\/haghiri75.com\/en\/category\/computer\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/haghiri75.com\/en\/wp-content\/uploads\/frontbricks.png?resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/haghiri75.com\/en\/wp-content\/uploads\/frontbricks.png?resize=350%2C200 1x, https:\/\/i0.wp.com\/haghiri75.com\/en\/wp-content\/uploads\/frontbricks.png?resize=525%2C300 1.5x, https:\/\/i0.wp.com\/haghiri75.com\/en\/wp-content\/uploads\/frontbricks.png?resize=700%2C400 2x, https:\/\/i0.wp.com\/haghiri75.com\/en\/wp-content\/uploads\/frontbricks.png?resize=1050%2C600 3x"},"classes":[]},{"id":300,"url":"https:\/\/haghiri75.com\/en\/nucleus-is-the-proof-that-small-is-the-new-big\/","url_meta":{"origin":377,"position":3},"title":"Nucleus is the proof that “Small is the new Big”","author":"prp-e","date":"January 13, 2024","format":false,"excerpt":"No matter what you heard, size matters. Specially in the world of AI models, having a smaller and more affordable model is the key to win the competition. This is why Microsoft even invested time, GPU and money on Phi project, which is a Small Language Model or SLM for\u2026","rel":"","context":"In "Computer Architecture & Programming"","block_context":{"text":"Computer Architecture & Programming","link":"https:\/\/haghiri75.com\/en\/category\/computer\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/haghiri75.com\/en\/wp-content\/uploads\/CEO.png?resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/haghiri75.com\/en\/wp-content\/uploads\/CEO.png?resize=350%2C200 1x, https:\/\/i0.wp.com\/haghiri75.com\/en\/wp-content\/uploads\/CEO.png?resize=525%2C300 1.5x, https:\/\/i0.wp.com\/haghiri75.com\/en\/wp-content\/uploads\/CEO.png?resize=700%2C400 2x"},"classes":[]},{"id":391,"url":"https:\/\/haghiri75.com\/en\/lets-build-metaverse-with-ai-building-asset-generator\/","url_meta":{"origin":377,"position":4},"title":"Let’s build Metaverse with AI: Building asset generator","author":"prp-e","date":"November 27, 2024","format":false,"excerpt":"Look at this: How do you think this apple has been made? Excellent question. After the previous post, I said we should put LLMs out of the picture for now. Also we needed to talk about 3D, because it is important in whole metaverse space, right? Today I just did\u2026","rel":"","context":"In "Projects"","block_context":{"text":"Projects","link":"https:\/\/haghiri75.com\/en\/category\/projects\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/mann-e-images.storage.c2.liara.space\/120c3554-8326-4625-a129-50e80bb215da_part_0003.png?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/mann-e-images.storage.c2.liara.space\/120c3554-8326-4625-a129-50e80bb215da_part_0003.png?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/mann-e-images.storage.c2.liara.space\/120c3554-8326-4625-a129-50e80bb215da_part_0003.png?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/mann-e-images.storage.c2.liara.space\/120c3554-8326-4625-a129-50e80bb215da_part_0003.png?resize=700%2C400&ssl=1 2x"},"classes":[]},{"id":202,"url":"https:\/\/haghiri75.com\/en\/severus-does-the-magic\/","url_meta":{"origin":377,"position":5},"title":"Severus does the magic","author":"prp-e","date":"September 11, 2022","format":false,"excerpt":"It is not too long after I told you that I was too cheap to pay $10 a month for github copilot and I came up with the idea for Severus, my own AI pair programmer. It was something that went boom. My blog usually doesn't have more than 20\u2026","rel":"","context":"In "Computer Architecture & Programming"","block_context":{"text":"Computer Architecture & Programming","link":"https:\/\/haghiri75.com\/en\/category\/computer\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/haghiri75.com\/en\/wp-content\/uploads\/warforged_wizard_by_captdiablo_de2mwm8-pre-1024x724.jpg?resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/haghiri75.com\/en\/wp-content\/uploads\/warforged_wizard_by_captdiablo_de2mwm8-pre-1024x724.jpg?resize=350%2C200 1x, https:\/\/i0.wp.com\/haghiri75.com\/en\/wp-content\/uploads\/warforged_wizard_by_captdiablo_de2mwm8-pre-1024x724.jpg?resize=525%2C300 1.5x"},"classes":[]}],"_links":{"self":[{"href":"https:\/\/haghiri75.com\/en\/wp-json\/wp\/v2\/posts\/377"}],"collection":[{"href":"https:\/\/haghiri75.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/haghiri75.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/haghiri75.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/haghiri75.com\/en\/wp-json\/wp\/v2\/comments?post=377"}],"version-history":[{"count":9,"href":"https:\/\/haghiri75.com\/en\/wp-json\/wp\/v2\/posts\/377\/revisions"}],"predecessor-version":[{"id":387,"href":"https:\/\/haghiri75.com\/en\/wp-json\/wp\/v2\/posts\/377\/revisions\/387"}],"wp:attachment":[{"href":"https:\/\/haghiri75.com\/en\/wp-json\/wp\/v2\/media?parent=377"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/haghiri75.com\/en\/wp-json\/wp\/v2\/categories?post=377"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/haghiri75.com\/en\/wp-json\/wp\/v2\/tags?post=377"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}