Better Searches With Local AI

Поділитися
Вставка
  • Опубліковано 26 гру 2024

КОМЕНТАРІ • 62

  • @kushagrasri
    @kushagrasri 7 місяців тому +76

    Hi Matt! thanks for checking it out. I'm working on major features like chat history, discovery, and new search types, and will roll them out eventually. It is still very early for Perplexica, but we're slowly reaching there. The searches are slower because Perplexity directly returns the result to the model instead of performing a similarity search. We do the opposite; after the search is complete, the results are refined and then returned to the model, this ensures that the context is very precise and the answers are some time better than Perplexity. We're working on adding some search types that allow you to disable this option.

    • @dotcomphoto7347
      @dotcomphoto7347 7 місяців тому

      That sounds great! Is it possible to use its services as API as well? Or just through the UI?

    • @new_artiko
      @new_artiko 7 місяців тому

      yeah, sound amazing! it is a open source project?

    • @mbarsot
      @mbarsot 7 місяців тому

      hi, great start for perplexica. My use case is creating news bullettin with queries like "top news from bbc news website, translated in italian with a title and a summary". Now: sometimes it works, sometimes it does not at all, others the reply is related to spurious parts of the bbc website (how to subscribe etc).
      Can you have us have a look at what is actually scraped from the websites (and which websites are selected), in order to make better queries to Perplexica ?

    • @riok4523
      @riok4523 6 місяців тому +1

      being able to add docs would be a huuuge plus!

  • @ambarrlite
    @ambarrlite 7 місяців тому +14

    Page Assist, an extension for chrome or firefox Ive been using awhile, does searches and can summarize the page. I forgot to add it uses local ollama models :)

    • @technovangelist
      @technovangelist  7 місяців тому +11

      I covered that in an earlier video. Perplexica does it in a very different way and is far more successful.

    • @ambarrlite
      @ambarrlite 7 місяців тому +1

      @@technovangelist I may have missed that vid, and I thought I had seen them all. I am a big fan of ollama. :)

  • @solporcima
    @solporcima 5 місяців тому +3

    Hello there I am wondering to see a video using ollama+ webui with web search + local llm

  • @joshharrison6020
    @joshharrison6020 7 місяців тому +9

    To be honest, if the application only offered a light mode, I would be less inclined to use it. I tend to use everything in dark mode. It’s not because I’m trying to reflect a certain persona or mood, but rather, I find that dark mode is easier on the eyes. This preference becomes particularly noticeable when I’m using the computer for extended periods, up to 18 hours at a time. The reduced strain on my eyes makes the experience much more comfortable.

    • @technovangelist
      @technovangelist  7 місяців тому +2

      I feel like this is a video I need to make, since this is flat out not true. It can feel like its easier at a point when you should be looking away, but it can cause issues later on, and its especially bad for 30% of the population. It's kind of like when folks say they are visual learners when most of the science based evidence says there is no such thing.

    • @svenvanwier7196
      @svenvanwier7196 7 місяців тому +1

      @@technovangelist while it might not be true, I experience the same, I think its all subjective. but never researched it.
      You made a genius point about probably touching some grass if strain comes into play xD

    • @ts757arse
      @ts757arse 7 місяців тому

      Make that video. I use dark mode most of the time and I find it depends on the monitor, surroundings and even the time of day. My laptop is awful to use in dark mode and I find it tiring and harder work. My main PC has four monitors, the two best ones being great in dark mode and the two cheapo ones being awful. I keep that whole system in dark mode and use the secondary monitors for things like open directories, Spotify, etc.

  • @tvwithtiffani
    @tvwithtiffani 7 місяців тому +7

    I simply love your reviews. Clearly highlighting pros & cons. This is how it should be done.

  • @blossom_rx
    @blossom_rx 7 місяців тому +1

    Hi Matt. I just stumbled upon your channel. I am really impressed! Thanks for providing actual knowledge instead of using clickbaity video titels without any real value. Keep it going. I hope your channel will be most successful. Quality over quantity.

  • @sridhartn83
    @sridhartn83 2 місяці тому

    For me flowise is already running on port 3000 and ollama webui on 8080, I changed all ports in .yaml files to use other ports than these but the webui for perplexica doesn't load, any idea how to fix this

    • @technovangelist
      @technovangelist  2 місяці тому

      in the docker file the ports statement for the frontend is 3000:3000. So maybe change that line to 3333:3000. That will forward the container port of 3000 to 3333 on your machine. port 3000 on the container will coincide fine with 3000 on any other container or your machine.

    • @sridhartn83
      @sridhartn83 2 місяці тому

      @@technovangelist I made it working, got the flowise to start on port 5000 and have perplexica run on its default 3000. will try your option as well but as its working now will not touch anything until something breaks ;-) Thanks for your reply :-)

  • @Ammarsays
    @Ammarsays 6 місяців тому +2

    Hi. Nice content. I like the pace of your videos. Everything is peaceful and interesting without loud music or dramatic sound effects. Please review fabric ai coupled with agents which are included with it.

    • @technovangelist
      @technovangelist  6 місяців тому

      Yeah, yeah, yeah. Fabric AI. Gotta do that one. Every now and then, I do add a little bit of music or a few sound effects, but I try not to make them too over the top.

  • @قيمنقعبود-ب2ل
    @قيمنقعبود-ب2ل 6 місяців тому

    Thanks. So what should we use for searching our documents.

    • @technovangelist
      @technovangelist  6 місяців тому

      This space is changing quickly, so I'm sure there's going to be another tool to try out for doing everything you could ever want. I think right now my favorite for doing a rag search is still OpenWebUI.

  • @jacobbobo4670
    @jacobbobo4670 6 місяців тому

    All of the dockers are running, but when I go to port 3000 I just have a loading screen that's been going for like 20 minutes. Does anyone know what I'm doing wrong? also Im running it through wsl.

  • @Slimpickens45
    @Slimpickens45 7 місяців тому +2

    Holy smokes this is cool. Great stuff as always Matt!

  • @UsmanAli-po5cm
    @UsmanAli-po5cm 4 місяці тому

    You can add Groq API in Msty and that will enable the real-time search mode. How is this better than Msty?

    • @technovangelist
      @technovangelist  4 місяці тому +1

      Same reason as wanting to use Ollama... comes down to security and privacy and sometimes cost.

    • @UsmanAli-po5cm
      @UsmanAli-po5cm 3 місяці тому

      @@technovangelist I installed and tested it. Msty with real time data enabled provided better search results. Perpelxica took nearly 20 gigabytes of my hard disk storage and results were no where as good as Msty with real time data enabled. Uninstalled it!

  • @dotcomphoto7347
    @dotcomphoto7347 7 місяців тому

    Really nice! Is there a way to use it as api as well? Or just using the UI?

  • @ThoughtFission
    @ThoughtFission 6 місяців тому

    What is currently the best RAG solution for docs?

    • @technovangelist
      @technovangelist  6 місяців тому

      That’s like asking whats the best model or whats the best car. There is no best and there can never be. It depends on your requirements.

  • @alvinnorin8820
    @alvinnorin8820 6 місяців тому

    The end was really appreciated.

  • @daan3298
    @daan3298 7 місяців тому

    What do I think? There are so many cool projects. But so little projects that make significant effort to combine all the cool projects. Some kind of standard that makes it easy to combine tools, use them as agents or whatever, that would be great. That's what I think.

  • @r-news-ny
    @r-news-ny 7 місяців тому

    Hi Matt, I wanted to ask if you could create a python script that will allow ollama +open webui to be able to search the Internet. I want to know if this idea will work? I'm new and learning this😊😊😊😊

  • @MeinDeutschkurs
    @MeinDeutschkurs 6 місяців тому

    What a great thing. Temporary embeddings for web research. ChromaDB + python + selenium. Should do it. Thx for inspiring me!

  • @IdPreferNot1
    @IdPreferNot1 7 місяців тому +1

    Appreciate your shares and balanced reviews.

  • @richardschloss9644
    @richardschloss9644 11 днів тому

    They have light/dark modes now (12/2024). I still like dark mode more.

  • @faster_than_bugs
    @faster_than_bugs 7 місяців тому

    self hosted AI search engine ? didn't know about it. Very interesting, will definitely try

  • @vulcan4d
    @vulcan4d 7 місяців тому +1

    Amazing work!

  • @mbarsot
    @mbarsot 7 місяців тому

    I think it is great, or in fact great potential. Would love to have a more stable retrieval from the web (see comment to the author down below), but in general most programs that work with ollama seems to be very good, so it is hard to settle to one solution (a good thing, in this case)

  • @c0t1
    @c0t1 7 місяців тому

    Another awesome video! Can't wait to try this out.

  • @dr.mikeybee
    @dr.mikeybee 7 місяців тому

    Which branch are you using?

  • @gu9838
    @gu9838 7 місяців тому

    plus having an offline option is great cuz i got to the perplexity website just now and it says there are too many users asking questions and yeahhhhhhhh great lol

  • @ihaveacutenose
    @ihaveacutenose 7 місяців тому +1

    You da man! That's exactly what I wanted to know!

  • @jofus521
    @jofus521 7 місяців тому

    I think there is a space for a robust knowledge curation app, so we can save the valuable results and tag them. Got a whole bunch of ideas around that. You always have fresh stuff, man. Wish I could pick your brain sometime. Planning to do something in all golang.

    • @technovangelist
      @technovangelist  7 місяців тому

      Ping me on the discord or if you are near Seattle we can meetup.

    • @jofus521
      @jofus521 7 місяців тому

      Cool thanks @technovangelist. On what server? A little new to discord. Can’t find a way to search. I’ve only joined from invites so far

    • @technovangelist
      @technovangelist  7 місяців тому

      Discord.gg/ollama. I’m mattw tvl.st/y

  • @DanielKirsch
    @DanielKirsch 7 місяців тому +3

    The profile shots are a bit weird. Not sure you should add them.

    • @DanielKirsch
      @DanielKirsch 7 місяців тому +2

      The awkward silence at the end is hilarious though.

  • @nadpro16
    @nadpro16 6 місяців тому

    I love it when I find something like this that im like, ooh I like that. Lets give it a try. And its broken....seigh.

  • @FlockofSmeagles
    @FlockofSmeagles 2 місяці тому

    Searxng = Searching. Clever, I know.

  • @inout3394
    @inout3394 7 місяців тому

    Msty, make simple app to search, use api, and rag

  • @Maisonier
    @Maisonier 7 місяців тому

    All this AI technology is still pretty green ...

  • @MH-xx6df
    @MH-xx6df 7 місяців тому +1

    Lightmode? Pleasing? C’mon, ever heard of circadian rhythms? Going out of whack due to monitor light. Let’s widen our knowledge base into more than just the digital world.

    • @technovangelist
      @technovangelist  7 місяців тому +1

      Your comment goes in two directions. First talk about rhythm, accepting that light mode is important, then you make up stuff about going out of whack due to monitors suggesting that dark mode is any better. Choose the argument and stick with it. Perhaps widen your knowledge to facts and not just made up stuff.

  • @dvn8ter
    @dvn8ter 7 місяців тому

    ⭐️⭐️⭐️⭐️⭐️