I build feature stores and my wife works in the media. Was thinking it would be cool to build various topic extraction models to parse the 5-Ws from article text - value prop is to simplify distill EVERY news article to a few bullets for easy consumption. We already have a near infinite data to test on and enough compute from a NLP standpoint. Definitely considering the bias aspect of all this but someone out there (not the media) would be interested in this from a product angle, right? Any thoughts on this? And anyone want to hop on this with me? submitted by /u/JasonSuave [link] [comments]

Hey ML Reddit! I just shipped a project I’ve been working on called Maroofy: https://maroofy.com You can search for any song, and it’ll use the song’s audio to find other similar-sounding music. Demo: https://twitter.com/subby_tech/status/1621293770779287554 How does it work? I’ve indexed ~120M+ songs from the iTunes catalog with a custom AI audio model that I built for understanding music. My model analyzes raw music audio as input and produces embedding vectors as output. I then store the embedding vectors for all songs into a vector database, and use semantic search to find similar music! Here are some examples you can try: Fetish (Selena Gomez feat. Gucci Mane) — https://maroofy.com/songs/1563859943 The Medallion Calls (Pirates of the Caribbean) — https://maroofy.com/songs/1440649752 Hope you like it! This is an early work in progress, so would love to hear any questions/feedback/comments! 😀 submitted by /u/BullyMaguireJr [link] [comments]

Github: https://github.com/google/vizier Google AI Blog: https://ai.googleblog.com/2023/02/open-source-vizier-towards-reliable-and.html Tweet from Zoubin Ghahramani: https://twitter.com/ZoubinGhahrama1/status/1621321675936768000?s=20&t=ZEuz9oSc_GWYxixtXDskqA submitted by /u/enderlayer [link] [comments]

We can change the colors of some texts and backgrounds on a SHAP summary plot by editing matplotlib's matplotlibrc file. We can also edit the plotting colors by passing a colormap but we're unable to change the colors of the "feature names" at the left side of the SHAP summary plot (beeswarm) -and the color of the y axis- by editing matplotlib's matplotlibrc file. Has anyone worked around this? Is there a way that we could overcome this restriction? submitted by /u/lekayra [link] [comments]

Is it allowed to use a public dataset like the KITTI dataset to test a model trained for commercial use? Note that the KITTI dataset is only allowed to be used for research purposes and the model is trained with different data (company specific). submitted by /u/alzoubi36 [link] [comments]

Is there a way to use OpenAI APIs to get the log prob of a given sentence? I don't want new completions, I want to see how the model scores given sentences. submitted by /u/Capable_Bumblebee645 [link] [comments]

I began exploring MLP-Mixer[1,2] on Graph Neural Networks in October 2021 and completed my implementation the ZINC dataset in November of the same year. My implementation is available on Github, but I was unable to fully conduct the experiments due to lack of computational resources. In December 2022, a group of leading figures in the field, including Xiaoxin He, Bryan Hooi, Thomas Laurent, Adam Perold, Yann Lecun, and Xavier Bresson, published a paper titled "A Generalization of ViT/MLP-Mixer to Graphs". Although I am pleased to be working alongside these prominent researchers on the application of MLP-Mixers to Graphs, I regret that I was unable to finish my experiments. Encouraged by my friends and advisors, I decided to make my work public by publishing it on arxiv. The paper and code can be found as the following: Paper/report: https://arxiv.org/abs/2301.12493 Github: https://github.com/asarigun/GraphMixerNetworks I used PNA as my baseline and did not utilize patches in my study, unlike the other study. I hope someone finds them interesting/useful. submitted by /u/asarig_ [link] [comments]

Hello everyone, I'm interested in diving into the field of computer vision and I recently came across the concept of Vision Transformer (ViT). I want to understand this concept in depth but I'm not sure what prerequisites I need to have in order to grasp the concept fully. Do I need to have a strong background in Recurrent Neural Networks (RNNs) and Transformer (Attention Is All You Need) to understand ViT, or can I get by just knowing the basics of deep learning and Convolutional Neural Networks (CNNs)? I would really appreciate if someone could shed some light on this and provide some guidance. Thank you in advance! submitted by /u/SAbdusSamad [link] [comments]

550K sentences in 5 European languages augmented with noise for training and evaluating spell correction tools or machine learning models. We have constructed our dataset to cover representatives from the language families used across Europe. Germanic - English, German; Romance - French; Slavic - Bulgarian; Turkic - Turkish; Use case example: Apply language models or other techniques to compare the sentence pairs and reconstruct the original sentences from the augmented ones. You can use a single multilingual solution to solve the challenge or employ multiple models/techniques for the separate languages. Per-word dictionary lookup is also an option. Link: https://github.com/radi-cho/noisy-sentences-dataset submitted by /u/radi-cho [link] [comments]

I'm guessing i probably am not the first person who has wanted to work with youtube data so I'm hoping here is a good place to ask So i had an idea to make a neural network that would go through your youtube history and then train a neural network on it. Afterwards if there is a way to access all of youtube by id in a way that you can check every video then you could store all of the id for videos you might like and then use a youtube downloader like youtube-dl to download a certain amount. Was just a dumb idea i had but now i want to actually try it but I'm unsure if I'll actually be able to get the data i need to do it submitted by /u/loonathefloofyfox [link] [comments]

[p] I am working on massive dataset, and in the future, we'll have to add some more classes over time, can I train the model in the only new classes?[p] submitted by /u/YukkiiCode [link] [comments]

Dear r/MachineLearning, Hello everyone! I hope you are all out there having fun, training deep nets and generating fun story-telling with stable-diffusion! 🙂 I am here today to share with you all a minimal ml project template that I've recently built, which can be found at https://github.com/AntreasAntoniou/minimal-ml-template/. I became increasingly annoyed at how there weren't any repos out there that provided stateless ML project templates, which are absolutely necessary when using kubernetes on spot instances, and I decided to build one. By stateless I mean a repo that by default can store model weights in a remote repo and then download them to continue from where it left off if the previous machine dies. The result was this repository. The repo remains minimal and extremely readable, all while being packed with a cool stack that I use every day. I'd love to get some feedback, so have a look and let me know. Regards, Antreas P.S. A short summary straight from the Github Repo: This repo implements a minimal machine learning template, that is fully featured for most of the things a machine learning project might need. The most important parts that set this repo apart from the rest are: It is stateless. Any given experiment ran using this template, will, automatically and periodically stores the model weights and configuration to HuggingFace Hub and wandb respectively. As a result, if your machine dies or job exits, and you resume on another machine, the code will automatically locate and download the previous history and continue from where it left off. This makes this repo very useful when using spot instances, or using schedulers like slurm and kubernetes. It provides support for all the latest and greatest GPU and TPU optimization and scaling algorithms through HuggingFace Accelerate. It provides mature configuration support via Hydra-Zen and automates configuration generation via decorators implemented in this repo. It has a minimal callback based boilerplate that allows a user to easily inject any functionality at predefined places in the system without spagettifying the code. It uses HuggingFace Models and Datasets to streamline building/loading of models, and datasets, but is also not forcing you to use those, allowing for very easy injection of any models and datasets you care about, assuming you use models implemented under PyTorch's nn.Module and Dataset classes. It provides plug and play functionality that allows easy hyperparameter search on Kubernetes clusters using BWatchCompute and some readily available scripts and yaml templates. The Software Stack This machine learning project template is built using the following software stack: 1. Deep Learning Framework: PyTorch 2. Dataset storage and retrieval: Huggingface Datasets 3. Model storage and retrieval Huggingface Hub, and HuggingFace Models 4. GPU/TPU/CPU Optimization and Scaling up options library: Huggingface Accelerate 5. Experiment configuration + command line argument parsing: Hydra-zen 6. Experiment tracking: Weights and Biases 7. Simple python based ML experiment running with Kubernetes using BWatchCompute submitted by /u/AntreasAntoniou [link] [comments]

Today, the NFL is continuing their journey to increase the number of statistics provided by the Next Gen Stats Platform to all 32 teams and fans alike. With advanced analytics derived from machine learning (ML), the NFL is creating new ways to quantify football, and to provide fans with the tools needed to increase their

The National Football League (NFL) is one of the most popular sports leagues in the United States and is the most valuable sports league in the world. The NFL, BioCore, and AWS are committed to advancing human understanding around the diagnosis, prevention, and treatment of sports-related injuries to make the game of football safer. More

Hi, I am working on project and for that I need a Twitter Domestic Violence Dataset. Basically I need a dataset with domestic violence tweets against woman. I have searched Kaggle and other websites but found no luck. Plus, I tried using Snscrape, but I need some phrases ideas related to domestic violence so I can get some tweets using that. I tried "Domestic Violence" , "My husband tried to kill me" and looking for more. Help is appreciated. submitted by /u/Naive-Aioli4849 [link] [comments]

Hi friends! I ran into this problem enough times at my last few jobs that I built a tool to solve it. I spent many hours building Docker containers for my Python functions, as many of the data science modules required building C libraries (since they significantly speed up compute-intensive routines, such as math calculations). Deploying the containers to AWS Lambda or Fargate (if the processes required more CPU or memory or were >15 minutes) and wiring functions to talk to each other using queues, databases, and blob storage made iterating on the actual code, which wasn't even that complex most of the time, slow. I made cakework https://github.com/usecakework/cakework, a platform that lets you spin up your Python functions as serverless, production-scale backends with a single command. Using the client SDK, you submit requests, check status, and get results. You can also specify the amount of CPU (up to 16 cores) and memory (up to 128GB) for each individual request, which is helpful when your data size and complexity varies across different requests. A common pattern that I built cakework for is doing file processing for ML: - ingest data from some source daily, or in response to an external event (data written to blob storage) - run my function (often using pandas/numpy/scipy) - write results to storage, update database - track failures and re-run/fix It's open source <3. Here are some fun examples to get you started: https://docs.cakework.com/examples Would love to hear your thoughts! submitted by /u/seattleite849 [link] [comments]

I have traffic speed time series data for each day of the week over several months, with data samples about every 30 seconds. I'd like to find periods of time (subsequences) where the speed is much slower than usual. Any recommendations for algorithms that would be well suited to this problem? Thanks submitted by /u/dudester_el [link] [comments]

Are there tools or techniques that permit you to joint query using more than one query vector? Use case: iterative ANN search refinement, where I start with a seed vector, select matches, and re-query with more examples to improve the search results. I tried doing this with FAISS, but it performs a "batch query" that returns a separate set of results for each query vector (not a joint query). submitted by /u/mostlyhydrogen [link] [comments]

For ImageNet classification, there are two common ways of normalizing the input images: - Normalize to [-1, 1] using an affine transformation (2*(x/255) - 1). - Normalize using ImageNet mean = (0.485, 0.456, 0.406) and std = (0.229, 0.224, 0.225). I observe that the first one is more common in TensorFlow codebases (including Jax models with TensorFlow data processing, e.g. the official Vision Transformers code), whereas the second is ubiquitous in PyTorch codebases. I tried to find empirical comparisons of the two, but there doesn't seem to be any. Which one is better in your opinion? I guess the performance shouldn't be too different, but still it's interesting to hear your experience. submitted by /u/netw0rkf10w [link] [comments]

Official blog post: https://www.microsoft.com/en-us/microsoft-365/blog/2023/02/01/microsoft-teams-premium-cut-costs-and-add-ai-powered-productivity/ Given the amount of money they pumped into OpenAI, it's not surprising that you'd see it integrated into their products. I do wonder how this will work in highly regulated fields (finance, law, medicine, education). submitted by /u/bikeskata [link] [comments]

Aligned LLMs such as InstructGPT and ChatGPT are trained via supervised fine-tuning after the initial self-supervised pretraining. Then, the researchers train a reward model on responses ranked by humans. When I understand correctly, they let the LLM generate responses that humans have to rank on a scale from 1-5. Then, they train a reward model (I suppose in supervised fashion?) on these ranked outputs. Once that's done, they use reinforcement learning (RL) with proximal policy optimization (PPO) to update the LLM. My question is why they use RL with PPO for this last step? Why don't they fine-tune the LLM using regular supervised learning, whereas the human-ranked outputs represent the labels. Since these are labels in the range 1-5, this could be a ranking or ordinal regression loss for supervised learning. submitted by /u/alpha-meta [link] [comments]

I wanted to use the Learnable Trainangulation model in a commercial project. The source code itself is under MIT licensing. However, the dataset they have used is Human3.6M, which states that the license is "FREE OF CHARGE FOR ACADEMIC USE ONLY". Yet, recent court rulings (in the US) state that models can use copyrighted data during training, and the results are no longer bound by that copyright (e.g. Google Books). Does the same apply here? submitted by /u/mfarahmand98 [link] [comments]

I've recently started reading up on classical ML and I got a question about K-Means. More concretely, I am confused about the uniqueness of the global optimal solution of K-Means's cost function. Let's state the problem formally below, extracted from Bishop's Pattern Recognition and Machine Learning book, exercise 9.1. Consider the 𝐾-means algorithm discussed in Section 9.1. Show that as a consequence of there being a finite number of possible assignments for the set of discrete indicator variables 𝑟𝑛𝑘, and that for each such assignment there is a unique optimum for the 𝝁𝑘, the K-means algorithm must converge after a finite number of iterations. I made an answer [here](https://stats.stackexchange.com/questions/603327/question-on-the-proof-of-convergence-of-k-means) detailing the proof of why it does converge in Lloyd's algorithm, but I think I still do not understand why Lloyd's do not converge to a global minimum, which mathematical theorem/understanding am I missing here? I think that optimizing both the assignments and the centroids of K-Means at the same time is non-convex and hence there are many local minimums, we can use brute force to search for the global minimum but of course it is exponential to the number of data points. On the other hand, Lloyd optimizes it (greedily) alternatively, and hence you will find the cost functions' local minima (guaranteed)? submitted by /u/healthymonkey100 [link] [comments]

https://preview.redd.it/ut4us5251rfa1.png?width=2000&format=png&auto=webp&s=dbf79c3832b20287203faa97e5c1303472bdbc22 Currently, the UI supports a picture upload and uses InstructPix2Pix to edit it. Also, it uses upscaling models for quality enhancements. More models are coming soon. The goal is to provide a way for non-ML people to use diffusion-based image editing through simplistic app design. Web demo: https://diffground.com/ submitted by /u/radi-cho [link] [comments]

I'm using Huggingface's transformers regularly for experimentations, but I plan to deploy some of the models to iOS. I have found ml-ane-transformers repo from Apple, which shows how transformers can be rewritten to have much better performance on Apple's devices. There's an example of DistilBERT implemented in that optimized way. As I plan to deploy transformers to iOS, I started thinking about this. I'm hoping some already have experience about this, so we can discuss: Has anyone tried this themselves? Do they actually see the improvements in performance on iOS? I'm using Huggingface's transformer models in my experiments. How much work do you think there is to rewrite model in this optimized way? It's very difficult to train transformers from scratch (especially if they're big 🙂 ), so I'm fine-tuning on top of pre-trained models on Huggingface. Is it possible to use weights from pretrained Huggingface models with the Apple's reference code? How difficult is it? submitted by /u/alkibijad [link] [comments]

https://www.axios.com/2023/02/01/chatgpt-subscriptions-chatbot-openai Not fully paywalled, but there's a tiering system. submitted by /u/bikeskata [link] [comments]

Almost 80% of today’s web content is user-generated, creating a deluge of content that organizations struggle to analyze with human-only processes. The availability of consumer information helps them make decisions, from buying a new pair of jeans to securing home loans. In a recent survey, 79% of consumers stated they rely on user videos, comments,

https://twitter.com/eric_wallace_/status/1620449934863642624?s=46&t=GVukPDI7944N8-waYE5qcw Extracting training data from diffusion models is possible by following, more or less, these steps: Compute CLIP embeddings for the images in a training dataset. Perform an all-pairs comparison and mark the pairs with l2 distance smaller than some threshold as near duplicates Use the prompts for training samples marked as near duplicates to generate N synthetic samples with the trained model Compute the all-pairs l2 distance between the embeddings of generated samples for a given training prompt. Build a graph where the nodes are generated samples and an edge exists if the l2 distance is less than some threshold. If the largest clique in the resulting graph is of size 10, then the training sample is considered to be memorized. Visually inspect the results to determine if the samples considered to be memorized are similar to the training data samples. With this method, the authors were able to find samples from Stable Diffusion and Imagen corresponding to copyrighted training images. submitted by /u/pm_me_your_pay_slips [link] [comments]

Recent developments in deep learning have led to increasingly large models such as GPT-3, BLOOM, and OPT, some of which are already in excess of 100 billion parameters. Although larger models tend to be more powerful, training such models requires significant computational resources. Even with the use of advanced distributed training libraries like FSDP and

Amazon SageMaker provides a suite of built-in algorithms, pre-trained models, and pre-built solution templates to help data scientists and machine learning (ML) practitioners get started on training and deploying ML models quickly. You can use these algorithms and models for both supervised and unsupervised learning. They can process various types of input data, including tabular,

Amazon Forecast is a fully managed service that uses machine learning (ML) to generate highly accurate forecasts, without requiring any prior ML experience. Forecast is applicable in a wide variety of use cases, including estimating supply and demand for inventory management, travel demand forecasting, workforce planning, and computing cloud infrastructure usage. You can use Forecast

Please post your questions here instead of creating a new thread. Encourage others who create new posts for questions to post here instead! Thread will stay alive until next one so keep posting after the date in the title. Thanks to everyone for answering questions in the previous thread! submitted by /u/AutoModerator [link] [comments]

This post is co-authored by Tristan Miller from Best Egg. Best Egg is a leading financial confidence platform that provides lending products and resources focused on helping people feel more confident as they manage their everyday finances. Since March 2014, Best Egg has delivered $22 billion in consumer personal loans with strong credit performance, welcomed

Today, gaining customer loyalty cannot be a one-off thing. A brand needs a focused and integrated plan to retain its best customers—put simply, it needs a customer loyalty program. Earn and burn programs are one of the main paradigms. A typical earn and burn program rewards customers after a certain number of visits or spend.

Model explainability refers to the process of relating the prediction of a machine learning (ML) model to the input feature values of an instance in humanly understandable terms. This field is often referred to as explainable artificial intelligence (XAI). Amazon SageMaker Clarify is a feature of Amazon SageMaker that enables data scientists and ML engineers

In November 2022, we announced that AWS customers can generate images from text with Stable Diffusion models in Amazon SageMaker JumpStart. Today, we announce a new feature that lets you upscale images (resize images without losing quality) with Stable Diffusion models in JumpStart. An image that is low resolution, blurry, and pixelated can be converted

It’s an exciting day for the development community. Cohere’s state-of-the-art language AI is now available through Amazon SageMaker. This makes it easier for developers to deploy Cohere’s pre-trained generation language model to Amazon SageMaker, an end-to-end machine learning (ML) service. Developers, data scientists, and business analysts use Amazon SageMaker to build, train, and deploy ML models quickly and easily using its fully managed infrastructure, tools, and workflows.

This post is co-written by Christopher Diaz, Sam Kinard, Jaime Hidalgo and Daniel Suarez  from CCC Intelligent Solutions. In this post, we discuss how CCC Intelligent Solutions (CCC) combined Amazon SageMaker with other AWS services to create a custom solution capable of hosting the types of complex artificial intelligence (AI) models envisioned. CCC is a

Amazon SageMaker Studio is a fully integrated development environment (IDE) for machine learning (ML) partly based on JupyterLab 3. Studio provides a web-based interface to interactively perform ML development tasks required to prepare data and build, train, and deploy ML models. In Studio, you can load data, adjust ML models, move in between steps to adjust experiments,

Amazon SageMaker JumpStart is the Machine Learning (ML) hub of SageMaker providing pre-trained, publicly available models for a wide range of problem types to help you get started with machine learning. Understanding customer behavior is top of mind for every business today. Gaining insights into why and how customers buy can help grow revenue. Customer churn is

This post is co-written with Jennifer Bergstrom, Sr. Technical Director, ParsonsX. Parsons Corporation (NYSE:PSN) is a leading disruptive technology company in critical infrastructure, national defense, space, intelligence, and security markets providing solutions across the globe to help make the world safer, healthier, and more connected. Parsons provides services and capabilities across cybersecurity, missile defense, space ground

This post is co-written by Ramdev Wudali and Kiran Mantripragada from Thomson Reuters. In 1992, Thomson Reuters (TR) released its first AI legal research service, WIN (Westlaw Is Natural), an innovation at the time, as most search engines only supported Boolean terms and connectors. Since then, TR has achieved many more milestones as its AI

This blog post is co-written with Chaoyang He and Salman Avestimehr from FedML. Analyzing real-world healthcare and life sciences (HCLS) data poses several practical challenges, such as distributed data silos, lack of sufficient data at a single site for rare events, regulatory guidelines that prohibit data sharing, infrastructure requirement, and cost incurred in creating a

This blog post is co-written with Chaoyang He and Salman Avestimehr from FedML. Analyzing real-world healthcare and life sciences (HCLS) data poses several practical challenges, such as distributed data silos, lack of sufficient data at any single site for rare events, regulatory guidelines that prohibit data sharing, infrastructure requirement, and cost incurred in creating a

This post was co-authored with Mark Lott, Distinguished Technical Architect, Salesforce, Inc. Enterprises that operate globally are experiencing challenges sourcing customer support professionals with multi-lingual experience. This process can be cost-prohibitive and difficult to scale, leading many enterprises to only support English for chats. Using human interpreters for translation support is expensive, and infeasible since

This is guest post by Andy Whittle, Principal Platform Engineer – Application & Reliability Frameworks at The Very Group. At The Very Group, which operates digital retailer Very, security is a top priority in handling data for millions of customers. Part of how The Very Group secures and tracks business operations is through activity logging