How to Create Data in Bulk in Bubble.io | Bubble.io Tutorial

[@GustavoCesario.]

You have no idea of how much you helped me with this tutorial. Thank you!!!

[@jacobgershkovich]

Nice! Happy to hear that.

[@lucasfs]

Very thanks from Brazil man!

[@geniosdossistemas]

In my input I have a "user" field, however, for bubble, this is not a text. How can I convert it so Bubble gets the info and add the info

[@foolestself]

Could you please create a tutorial on how this could work with GPT? Getting a list of things in JSON through ChatGPT API, then adding them to bubble DB

[@fredericklinus1771]

Could you please let me know when you figure this out…🙏

[@OrkaMarketing]

what happens if the json i am senfding has empty keys? i am facing this issue: {"status":"error","message":"Unrecognized field: 0","body":{"statusCode":400,"body":{"status":"ERROR","message":"Unrecognized field: 0"}}}

[@loganlira6679]

This tutorial helped me incredibly. Thank you very, very much.

[@finallyfinancial5255]

great tutorial! quick question: same use case, but I want to store/save in DB the creator of the data, such that if I have multiple users creating data, I can always filter by user. What would be the approach?

[@fredericklinus1771]

Does this work on the free plan?

[@akashhande]

I was able to get till the step where we have to make an external API call to get the list of to-dos, however, I am not able to see the option to "format as text". Any idea why?

[@akashhande]

Never mind, I resolved it by selecting the actual list of objects in the API response and it worked. Thanks.

[@akashhande]

but now I am facing an issue where only the first of the 10 objects is saved in database, other 9 are just not saved.

[@JuanBernard-z3r]

how many workloads does it take for lets say... 1000 items created

[@Planilha-de-Fluxo]

Hi Jacob, great tutorial, thanks! I'm having some issues regarding the data retrieval. I am guessing that because I bulk create and those things aren't coming with "created by" (current user) the fetching of the data is unoptimzed causing delays on data manipulation in my app. How to fix this?

[@itsmikepowers]

your actually a life saver! great content!

[@jacobgershkovich]

Thanks Mike!

[@theoutpost3146]

I'm getting this in initialization stage: Raw response for the API Status code 400 {"status":"error","message":"Unrecognized field: name","body":{"statusCode":400,"body":{"status":"ERROR","message":"Unrecognized field: name"}}} INPUT: {"name":"test"} I was wondering if you might have an idea why that is? All I have in my data type so far is a field called "name"

[@NickSinai3]

your field names don't match between the api and as defined in the api connector

[@jacobgershkovich]

Check for extra spaces in the field names...but yes, there's a mismatch.

[@theoutpost3146]

@@jacobgershkovich Yeah I thought there's a mismatch but I've tried every field on for size directly copy and pasting it from the data types input to make sure it's exact. Still no luck. I was just wondering if there is anything else that you might have run into along the way

[@theoutpost3146]

Ok I found the solution: Bubble created all my fields with "_text" after the name I gave it. So for example I called it "name" bubble changed the field name to "name_text" because it was a text field. So I did a get request to the endpoint to see what bubble calls it. Next the problem was it could not parse as JSON when I copy pasted bubble's response back into the body. The json data was valid but because we are using the raw there can't be any spaces in the text. So i had to delete all the spaces in the json so it's just one big string and then boom it worked! Yew

[@jacobgershkovich]

@@theoutpost3146 Nice!

[@FoundersTerrapin]

Thank you for the great tutorial - really well thought through and presented. My question is now to manage the data accumulating with each call, when many items from a particular call won't change, and/or are made as it's not possible to manipulate a json return in custom state to manage a workflow. In my case I'm making a call to an api and retrieving objects in an array that relate to multiple properties in a zip code area, I want just the one that the user will specify and then make a separate call based on the unique key contained in the object for that single. property. The rest of the data (and it's a lot) is not required and is largely static in any case.

[@andresfeliperiostamayo7307]

what if one of the fiels that i want to create refers to an existing item in other table?

[@jacobgershkovich]

Good question, have you tried just using the unique ID? Did it work?

[@andresfeliperiostamayo7307]

@@jacobgershkovich yes, and it worked!

[@fillipesantos6172]

Can you please show how to send a csv file from front end bubble e return data like this?

[@jacobgershkovich]

I'll keep it mind for a future vid!

[@khalidku]

Thank you so much Jacob. It was really helpful. What if we want to get larger amount of data, for example 6000 record, how can we change the timing?

[@shanerosengren3521]

I seem to be stuck at the initialization step: {"status":"error","message":"Could not parse as JSON: {\"id\": 1, \"title\", \"test\", \"completed\": false}

[@jacobgershkovich]

Make sure to check that your JSON is formatted correctly. Sometimes there can be a quotation mark or something small that's messing things up.

[@shanerosengren3521]

@@jacobgershkovich Thanks! I found a comma after "title" instead of a colon. That fixed it.

[@drewkosel]

I'm trying to get data from an API put it into the database but only new entries.. new entries, hopefully will be created 24 hours a day by users. I can get the API data, I can get into the database, but not based on only new entries into the external database that Im retrieving from the API. Any thoughts?

[@jacobgershkovich]

Could you set up a different backend process that checks for / removes duplicates?

[@tomaszwieczorek3310]

This method with :format as text work nicely but only if you have small amount like 3 maybe 4 things to change. I have tried this on product from catalogue where I have 15+ fields for each product and this doesn't work even for smaller batches of products.

[@jacobgershkovich]

That shouldn't matter. Are you sure you weren't formatting any of the fields incorrectly? You should be able to see that in the error logs.

[@tomaszwieczorek3310]

​@@jacobgershkovich I've been slowly adding those fields manually with exact formatting and testing this with a batches of 50 and below. I've been checking the database of the target system. So the only thing that changed was the total amount of products processed. I tried also a different approach and this is what I'm testing now. I create the records with your method but I only push 1 additional field so - this part works nice. Then after the record is created I use database triggers to do an API call to main system to pull more data and update the records but even this causes some issues inside bubble because of the speed. Yesterday I played a bit with delays for all those operations and it seems like that I will have to stay with recursive workflow for this product catalogue sync - fact is, that its super slow and my product catalogue is barely 1k items. Unless you have a better idea how to sync two product catalogues between bubble apps?

[@jhansip6375]

Can you please make video on how to send the data from one csv file to 2 different tables?

[@jacobgershkovich]

I'll keep that in mind for sure for a future vid!

[@theperksfam3449]

Excellent work, as always.

[@jacobgershkovich]

Thank you!

[@98wongjf]

Hi. The link to your API documentation no longer works. I seem to have found new Bubble documentation on this topic and they are terrible. Nothing like what I see in your video.

[@onlyhcfreak]

How would you parse other data formats such as dates, images, and even list of text being returned from the API Call that should be stored on a list in bubble? :)

[@jacobgershkovich]

I haven't messed around with that too much, but my guess would be it would be okay...I would guess sending the UNIX timestamp would work for the date (if not, some format for the date probably would), for the image, as long as it's just a url pointing to where the image is hosted, that should be fine; and a list of texts, if you just had that formatted as a string of arrays, I would imagine that would work?

[@onlyhcfreak]

@@jacobgershkovich Thanks for the inspiration, I guess I'll get the image and list of texts to work somehow. Just needs some tinkering probably. Concerning the date, I'll have to test it. It would be amazing if bubble could take the text and convert it to a date, as done in the API connector. I'll drop the solution here when I have it! :) Thanks Jacob!

[@DevinFraze]

@@onlyhcfreak did you figure this out?

[@onlyhcfreak]

@@DevinFraze unfortunately not yet... :(

[@alexlefkowitz]

Keep the good content coming 🙏😍

[@jacobgershkovich]

Thanks!

[@rodacki]

It helped me a lot, thanks!

[@lucianaelisa9501]

Help a lot! Thank you!!!

[@jacobgershkovich]

Glad it helped!

[@salesgurupro]

Love your channel. Really great content and awesome explanation! How do you use a bulk create if you have a nested json with some fields belonging to a different table? And those fields need to be mapped/related back to some other table

[@jacobgershkovich]

Good question! That would definitely be a tricky one. I'd look into using data triggers?

[@pratimadudhewar3680]

@@jacobgershkovich Please make a video on that.. I too have a nested JSON with diff tables. So not sure about how to do mappinf for that.

[@loganlira6679]

My friend, how do I make a donation to your channel, this video helped me a lot.

[@javi_v7.0]

Thank you!

[@RaphaelLasry]

Great content!

[@jacobgershkovich]

Thanks!

[@mevist77]

Great video, thanks! Made me subscribe to the channel :)

[@jacobgershkovich]

Nice! Glad you liked it. Welcome to the channel.

[@jaguarconsultoriadigital8147]

Thanks man

[@bsgoodmail]

Thank you for that video... Does anybody know if I can do something similar for uploading a bulk of pictures? I would prefer to watch a video. Please show some love!

[@AutomationWithSholz]

damn..very helpful....but all this just to bulk upload/insert data... Just Damn

[@hustlin_heev]

This format as text is interesting.. My app has an order form. The user can select more than 1 product variant and a quantity on a form and submit an order. So for example 1 shirt size S and 1 pants size Large. I save these both in different states. selected_product: shirt, pants and selected_size: S, Large. The order API needs to take in “line items” like this: { "order": { "line_items": [ { "variant_id": 41385256878173, "quantity": 1 }, { "variant_id": 41385256943709, "quantity": 1 } ], How do I split the list of things in the state to go into the API array? How does it know that shirt is small and pants are large and not a large shirt? How does the API dynamically adapt to the number of items ordered - 2,3,4… and know to add more brackets and keys?