• Skip to main content
  • Skip to header right navigation
  • Skip to site footer

My Online Training Hub

Learn Dashboards, Excel, Power BI, Power Query, Power Pivot

  • Courses
  • Pricing
    • Free Courses
    • Power BI Course
    • Excel Power Query Course
    • Power Pivot and DAX Course
    • Excel Dashboard Course
    • Excel PivotTable Course – Quick Start
    • Advanced Excel Formulas Course
    • Excel Expert Advanced Excel Training
    • Excel Tables Course
    • Excel, Word, Outlook
    • Financial Modelling Course
    • Excel PivotTable Course
    • Excel for Customer Service Professionals
    • Excel for Operations Management Course
    • Excel for Decision Making Under Uncertainty Course
    • Excel for Finance Course
    • Excel Analysis ToolPak Course
    • Multi-User Pricing
  • Resources
    • Free Downloads
    • Excel Functions Explained
    • Excel Formulas
    • Excel Add-ins
    • IF Function
      • Excel IF Statement Explained
      • Excel IF AND OR Functions
      • IF Formula Builder
    • Time & Dates in Excel
      • Excel Date & Time
      • Calculating Time in Excel
      • Excel Time Calculation Tricks
      • Excel Date and Time Formatting
    • Excel Keyboard Shortcuts
    • Excel Custom Number Format Guide
    • Pivot Tables Guide
    • VLOOKUP Guide
    • ALT Codes
    • Excel VBA & Macros
    • Excel User Forms
    • VBA String Functions
  • Members
    • Login
    • Password Reset
  • Blog
  • Excel Webinars
  • Excel Forum
    • Register as Forum Member

Unstructured Raw Data from Website|Power Query|Excel Forum|My Online Training Hub

You are here: Home / Unstructured Raw Data from Website|Power Query|Excel Forum|My Online Training Hub
Avatar
sp_LogInOut Log In sp_Registration Register
sp_Search Search
Advanced Search|Last Search Results
Search
Forum Scope




Match



Forum Options



Minimum search word length is 3 characters - maximum search word length is 84 characters
sp_Search Search
sp_RankInfo
Lost password?
sp_CrumbsHome HomeExcel ForumPower QueryUnstructured Raw Data from Website
sp_PrintTopic sp_TopicIcon
Unstructured Raw Data from Website
Avatar
Nazaar Shadir

New Member
Members
Level 0
Forum Posts: 2
Member Since:
April 24, 2021
sp_UserOfflineSmall Offline
1
April 24, 2021 - 12:59 pm
sp_Permalink sp_Print

Hi - thanks for the invite, I am glad to be here. 

I am looking to systematically extract data from this website into Excel.  Each Friday this site updates it's data for futures contracts. 

This is the website: https://www.cftc.gov/dea/futur.....acmesf.htm

The information which is relevant to me is the LONG and SHORT values per futures instrument, i.e CANADIAN DOLLAR, SWISS FRANC, BRITISH POUND STERLING, JAPANESE YEN etc (each future contract also has a code #) 

I tried importing through excel Data tab through From Web option. I also tried saving it as txt file and opening in excel through text to columns, but I can't get it formatted as the raw information seems unstructured.  

Any help or suggestions how to extract this specific information:

LONG | SHORT | LONG | SHORT

53,824 40,578  71,858 113,008

Thanks in advance.  
sp_AnswersTopicSeeAnswer See Answer
Avatar
Mynda Treacy
Admin
Level 10
Forum Posts: 4447
Member Since:
July 16, 2010
sp_UserOfflineSmall Offline
2
April 24, 2021 - 9:49 pm
sp_Permalink sp_Print

Hi Nazaar,

Welcome to our forum! Thanks for sharing the link. Unfortunately, the data on that page is not in a format Power Query in Excel or Power BI can 'see'. 

However, you can use Get Data > From Web. Then at the Navigator select the 'Document' and 'Transform Data'. In the PQ editor window delete the 'Navigation' step. Click on the cog for the Source step and change 'open file as' to 'Text File'. You can then remove the top n rows and go about cleaning the rest of the data.

Hope that points you in the right direction.

Mynda

sp_AnswersTopicAnswer
Answers Post
Avatar
Nazaar Shadir

New Member
Members
Level 0
Forum Posts: 2
Member Since:
April 24, 2021
sp_UserOfflineSmall Offline
3
April 25, 2021 - 4:48 am
sp_Permalink sp_Print

Hi - thanks for the quick reply.  I am going to try your suggestions.  I have not used PQ ever, which of of your training vidoes would you recommend to watch to do this specific job?

The data updates each Friday and I need to go through the historical data and pull the stats for about 10 futures contract.  

Thank you. 

Avatar
Mynda Treacy
Admin
Level 10
Forum Posts: 4447
Member Since:
July 16, 2010
sp_UserOfflineSmall Offline
4
April 25, 2021 - 11:38 am
sp_Permalink sp_Print

Hi Nazaar,

If you haven't ever used Power Query it's going to be a bit tricky as you'll need to use loads of different techniques to clean this data including splitting columns, removing rows and more. I cover these techniques in my Power Query course, but I don't have any videos on YouTube that specifically teach these skills, sorry.

Have a go and if you get stuck, consider my course, or come back here.

Mynda

sp_Feed
Go to top
Forum Timezone: Australia/Brisbane
Most Users Ever Online: 245
Currently Online: Velouria
Guest(s) 12
Currently Browsing this Page:
1 Guest(s)
Top Posters:
SunnyKow: 1432
Anders Sehlstedt: 870
Purfleet: 412
Frans Visser: 346
David_Ng: 306
lea cohen: 219
A.Maurizio: 202
Jessica Stewart: 202
Aye Mu: 201
jaryszek: 183
Newest Members:
Hayden Hao
Angela chen
Sean Moore
John Chisholm
vexokeb sdfg
John Jack
Malcolm Toy
Ray-Yu Yang
George Shihadeh
Naomi Rumble
Forum Stats:
Groups: 3
Forums: 24
Topics: 6211
Posts: 27238

 

Member Stats:
Guest Posters: 49
Members: 31891
Moderators: 3
Admins: 4
Administrators: Mynda Treacy, Philip Treacy, Catalin Bombea, FT
Moderators: MOTH Support, Velouria, Riny van Eekelen
© Simple:Press —sp_Information

Sidebar

Blog Categories

  • Excel
  • Excel Charts
  • Excel Dashboard
  • Excel Formulas
  • Excel PivotTables
  • Excel Shortcuts
  • Excel VBA
  • General Tips
  • Online Training
  • Outlook
  • Power Apps
  • Power Automate
  • Power BI
  • Power Pivot
  • Power Query
microsoft mvp logo
trustpilot excellent rating
Secured by Sucuri Badge
MyOnlineTrainingHub on YouTube Mynda Treacy on Linked In Mynda Treacy on Instagram Mynda Treacy on Twitter Mynda Treacy on Pinterest MyOnlineTrainingHub on Facebook
 

Company

  • About My Online Training Hub
  • Disclosure Statement
  • Frequently Asked Questions
  • Guarantee
  • Privacy Policy
  • Terms & Conditions
  • Testimonials
  • Become an Affiliate

Support

  • Contact
  • Forum
  • Helpdesk - For Technical Issues

Copyright © 2023 · My Online Training Hub · All Rights Reserved. Microsoft and the Microsoft Office logo are trademarks or registered trademarks of Microsoft Corporation in the United States and/or other countries. Product names, logos, brands, and other trademarks featured or referred to within this website are the property of their respective trademark holders.