Lookup Activity in ADF and Synapse | Read Content of File, query Tables in DB |

Lookup Activity in ADF and Synapse | Read Content of File, query Tables in DB | #cloudknowledge
Lookup activity can retrieve a dataset from any of the data sources supported by data factory and Synapse pipelines. You can use it to dynamically determine which objects to operate on in a subsequent activity, instead of hard coding the object name. Some object examples are files and tables.
Lookup activity reads and returns the content of a configuration file or table. It also returns the result of executing a query or stored procedure. The output can be a singleton value or an array of attributes, which can be consumed in a subsequent copy, transformation, or control flow activities like ForEach activity.
Supported capabilities
Note the following:
The Lookup activity can return up to 5000 rows; if the result set contains more records, the first 5000 rows will be returned.
The Lookup activity output supports up to 4 MB in size, activity will fail if the size exceeds the limit.
The longest duration for Lookup activity before timeout is 24 hours.
#education #azuredatafactory #azuresynapse #learning #azuretutorials #synapseanalytics #datafactory

[@funworld8659]

very usefull excellent content

[@CloudKnowledgeChannel]

Thanks

[@funworld8659]

i tried the same usecase with getmetadata activity with expression size not equals to zero it also works fine

[@user-mk8ku8bb8n]

keep going on good vedios

[@CloudKnowledgeChannel]

Thank you, I will 👍

[@sumanappukutty9154]

very usefull. I watched so many vedios nothing can help me to get to know about lookup but your vedio is such amazing one.

[@CloudKnowledgeChannel]

Thanks for your kind words

[@ahan1495]

Hi, at the <a href="#" class="seekto" data-time="1500">25:00</a> minute mark, why do we need to set the wildcard file path ? Will it not work if I keep it as file path in dataset ? Nice explanation on the rest ! Thank you !

[@CloudKnowledgeChannel]

Thanks, this is just a demo on activity. There can be many ways in doing same task.

[@user-is3wf5ee6k]

Instead of Defining Parameter in Pipeline level and provide filename one by one, we can use For Each activity also. Please correct me if my approach is wrong.

[@CloudKnowledgeChannel]

You may do so. This Video is just demonstration of individual activity.

[@akshatyadav7230]

Can we copy the data where salary is greater than a certain amount from the file without using query If yes than please tell about the process

[@barnaliroy8703]

Can I run 2 Lookup activities in parallel? If yes then How?