Write file to Google Cloud Storage with Spring Boot

[@surendranathreddy9596]

Can you show how to upload images in the GCP bucket while uploading in website front end using springboot

[@pratikgaikwad688]

This playlist is really clear, easy to understand and helpful, thank you @CarbonRider

[@dkon8288]

Thank you. Can you show how to create folder in the bucket and then load the document into that folder ?

[@CarbonRiderOnline]

Hi @D Kon, One of the possible way is to map the google cloud storage to a VM using GCS Fuse and then make use of java file API to interact with it.

[@dkon8288]

CarbonRider thank you

[@manueljaramillooporto6120]

how can I change the metadata type? to text/csv for example, not the default application/octet-stream. THANK YOU

[@CarbonRiderOnline]

You can do that using setContentType method available on BlobInfo object.

[@rjcdz06]

Excellent! It is useful and clear! Thanks!

[@torbendury4374]

I really enjoyed your tutorial on uploading files to GC Storage, thank you! Is it also possible to upload them to a specific subdirectory in the Bucket?

[@CarbonRiderOnline]

Hi @Torben, Thanks for your words. Yes, its very much possible to upload file inside a subdirectory. You can do something like this BlobId myFileBlobId = BlobId.of("mybucket", "images/mylocalimage.jpg");

[@siddharthbhandari7601]

I do see you haven't showed authentication part, does your bucket allow anyone to upload files?

[@CarbonRiderOnline]

Hi Siddharth, Sorry, I missed to show the authentication details in this video. The bucket doesn't allow public access and it is indeed protected. The reference of the authentication JSON file was provided using following property in application.properties file spring.cloud.gcp.credentials.location=classpath:/gcp-credentials.json

[@siddharthbhandari7601]

@@CarbonRiderOnline can you please also help me to provide command to generate authentication in json format.

[@CarbonRiderOnline]

The JSON was generated using GCP cloud console itself. It was created for service account. I do have another video about that.

[@siddharthbhandari7601]

@@CarbonRiderOnline can you please share link with me

[@CarbonRiderOnline]

Here you go ----- Creating service account kzbin.info/www/bejne/Zl7GhJKnfpWLeac ---- Assign role to service account kzbin.info/www/bejne/gIGTYmyYrZhmodE

[@mukhammadabdullaev9476]

It's really useful! Thank you! :)

[@KristinaMantha]

I am getting an error on storage.create(blobInfo, data); --> seems the create method does not exist in type Storage. Do you know if something has changed?

[@CarbonRiderOnline]

Kristina, The method should have worked. Please check the official documentation, it also shows and example googleapis.dev/java/google-cloud-storage/latest/com/google/cloud/storage/Storage.html#create-com.google.cloud.storage.BlobInfo-byte:A-com.google.cloud.storage.Storage.BlobTargetOption...-

[@sockettofan480]

Thanks for the tutorial...Is there way to download file of any mediatype from cloud storage using spring boot?

[@CarbonRiderOnline]

Yes, you can download any file.

[@kirillknyazevknyazew1634]

How can I store GCS connection variables as environment variables. It's not safe to keep JSON file.

[@CarbonRiderOnline]

You shouldn't keep the JSON file inside the project source code. It can be easily be stored in Secret manager or Environment variable. If you are using docker, then you can fetch the file contents and write it to a location which can be then read by your program.

[@Pedro1bc]

I'm getting java.nio.file.NoSuchFileException when trying to run it, even though the path is correct.

[@bollywood90ssongs65]

Can you store that file into image folder that will help us

[@CarbonRiderOnline]

It can be achieved by adding the folder name in the BlobId object being constructed. BlobId.of("bucketname", "images/myfile.txt");

[@chenwang3427]

if the application is deployed to GCP GKE and not check in your service account json with your source code, then how do you do?

[@CarbonRiderOnline]

I am note sure about GCP. But in case of AWS, there is option to assume role.

[@ankitachandankar8687]

I am getting an error while running an application. Error: Project ID cannot be null or empty

[@ankitachandankar8687]

Also I am getting an error while running Curl

[@CarbonRiderOnline]

What error are you getting?

[@ankitachandankar8687]

@@CarbonRiderOnline Please ignore this error, it was my bad that I did not specified @RestController to my controller method.

[@ankitachandankar8687]

Also, could you please upload the same videos with the use of Swagger open api spec and storing file metadata into DB .

[@CarbonRiderOnline]

@Ankita, using swagger and DB operations is a different topic.

[@arifalimadina7091]

It's taking time to upload image about 2-3 sec. Can we do it faster

[@CarbonRiderOnline]

The other way is to mount the GCP storage using GCSFuse utility and use java.io.* APIs to interact with the storage. That may improve the performance.

[@arifalimadina7091]

@@CarbonRiderOnline any reference , any blog ?

[@CarbonRiderOnline]

@Arif check this github.com/GoogleCloudPlatform/gcsfuse

[@chetanchoudhary7688]

do you have this project in git

[@ankitachandankar8687]

How you configure the Default Project ID??

[@CarbonRiderOnline]

The service account json file contains reference of the project and hence you do not have to configure it.

[@ankitachandankar8687]

@@CarbonRiderOnline I agree that service account json file contains the reference of the project id, but, still I was getting an error that project ID cant be Null or Empty. So what I did is, I explicitly set the ProjectID variable in my application.properties file and It started running the applicattion

[@CarbonRiderOnline]

@Ankita usually the project id is required by the services like GCP translation and not for storage. Can you paste the exception stack trace along with error message? Also which property did you configure in the application.properties?

[@nikhillingam4630]

Anyone knows how to write unit test for it

[@CarbonRiderOnline]

I haven't done that. But can you be more specific as what part of GCP storage that you wish to unit test?

[@nikhillingam4630]

@@CarbonRiderOnline file upload/fetch/delete from google storage with java

[@CarbonRiderOnline]

Is the intention to check if Google SDK APIs are working as expected? OR do you wish to check your own logic to interact with it? Ideally while writing unit test cases, you shouldn't test third party libraries (if it involves network calls or dependency on third party service).

[@kousarjamadar7339]

Could you please help me to upload 1Mb file TO Bucket?

[@CarbonRiderOnline]

Yes, you can upload the file using the storage API.

[@namratagove537]

I am getting Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException: 401 Unauthorized error

[@CarbonRiderOnline]

@Namrata, can you please check if you have provided required permission to the service account? If you are reading/writing content to the existing storage bucket, then you should have "Storage object creator" role assigned to the service account.