Research: Difference between revisions

From Irregularpedia
Jump to navigation Jump to search
init
Tag: wikieditor
→‎Research Inspired by the Intel Cycle: added link to the research pathway
 
(7 intermediate revisions by 3 users not shown)
Line 3: Line 3:


The Typical Intel Cycle inspires organizing and conducting general research. This article outlines the four main steps of research inspired by the Cycle and provides recommendations for websites and tools to assist in each stage.
The Typical Intel Cycle inspires organizing and conducting general research. This article outlines the four main steps of research inspired by the Cycle and provides recommendations for websites and tools to assist in each stage.
Are you starting your path to improving your research skills, especially after completing open-source research training or courses? See this community guide for ways to begin:  [[Community Recommended Pathways/Research]]


== Research Resources ==
== Research Resources ==
[Login Only Community Research Section](/community/research/datasets)
# [[National_Strategy_and_Reports]]
 
# [[Research Preparation|Plan and Prepare]]
# Plan and Prepare
## [[Research Preparation#Pre-Browsing Checks|DFP for Research]]
## DFP for Research
* [[research-containers|Containers for Research|]]
* [[Containers for Research|/resources/guides/dfp-guide/research-containers]]
# [[research-planning|Research Planning Guide]]
# [[Research Planning Guide|/topic/research/research-planning]]
# [[Structured Analytic Techniques|Structured Analytic Techniques (SATs)]]
# [[Structured Analytic Techniques (SATs)|/topic/research/structured-analytic-techniques]]
# [[pmesii-pt|PMESII-PT]]
# [[PMESII-PT|/topic/research/pmesii-pt]]
# [[cog|Center of Gravity (COG) Analysis]]
# [[Center of Gravity (COG) Analysis|/topic/research/cog]]
# [[about-research-template|Research Templates]]
# [[Research Templates|/community/research/about-research-template]]


# Gather
# Gather
## [[Research Datasets|/topic/research/research-datasets]]
## [[research-datasets|Research Datasets]]
## [[Darkweb Links|/topic/research/darkweb-links]]
## [[darkweb-links|Darkweb Links]]
## [[Research Tools|/topic/research/research-platforms]]
## [[research-platforms|Research Tools]]
## [[Leaks and Compilations|/topic/research/leaks]]
## [[leaks|Leaks and Compilations]]
## [[Citation|/topic/research/research-citation]]
## [[research-citation|Citation]]
## [[ai-prompting for advanced queries|/topic/research/research-platforms/ai-prompting.md]]
## [[ai-prompting|ai-prompting for advanced queries]]


# Process and Analyze
# Process and Analyze
## [[Forms for Processing|/community/guides/research/forms]]
## [[forms|Forms for Processing]]
## [[R Studio Guide|/community/guides/research/rstudio]]
## [[rstudio|R Studio Guide]]


== Research Guides ==
== Research Guides ==
* [OSINT in 5 Hours](https://www.youtube.com/watch?v=qwA6MmbeGNo)
* [https://www.youtube.com/watch?v=qwA6MmbeGNo OSINT in 5 Hours]


[[File:INTEL and OPS Cycle.png|alt=Image of a Typical Intel Cycle]]
[[File:INTEL and OPS Cycle.png|alt=Image of a Typical Intel Cycle]]
[[File:data-information-ops-research.png|alt=Data, Information, Operations, and Research]]


== Planning For Research ==
== Planning For Research ==
Line 38: Line 39:
Proper planning is crucial to ensure the success of any research project. This phase involves identifying the research question or problem, formulating a hypothesis, and establishing a clear and focused research objective. This guide also includes setting up systems, networks, accounts, and devices.  
Proper planning is crucial to ensure the success of any research project. This phase involves identifying the research question or problem, formulating a hypothesis, and establishing a clear and focused research objective. This guide also includes setting up systems, networks, accounts, and devices.  


See the [[Research Planning Guide|/topic/research/research-planning]] section for a full guide.
See the [[research-planning|Research Planning Guide]] section for a full guide.


=== Recommended Research Planning Resources ===
=== Recommended Research Planning Resources ===


* [Goldilocker Tool](https://apps.lib.umich.edu/rq/): For refining research questions in a guided approach
* [https://apps.lib.umich.edu/rq/ Goldilocker Tool]: For refining research questions in a guided approach
* [ROOBRICK](https://www.roobrick.org/#/): A collaborative way to do COG Analysis with others while maintaining each planning session for knowledge management. Weights are customizable and go from 0 (lowest) to 1 (highest)
* [https://www.roobrick.org/#/ ROOBRICK]: A collaborative way to do COG Analysis with others while maintaining each planning session for knowledge management. Weights are customizable and go from 0 (lowest) to 1 (highest)
* [Mendeley](https://www.mendeley.com): For organizing and managing references and research materials.
* [https://www.mendeley.com Mendeley]: For organizing and managing references and research materials.
* [Draw.io / Diagrams.net](https://app.diagrams.net/): Create mind maps to help visualize and structure your research ideas. It does not require a login.
* [https://app.diagrams.net/ Draw.io / Diagrams.net]: Create mind maps to help visualize and structure your research ideas. It does not require a login.


== Gathering Data ==
== Gathering Data ==
Line 53: Line 54:
=== Recommended Data Collection Resources ===
=== Recommended Data Collection Resources ===


* [Elicit](https://elicit.org/for): Uses language models to help you automate research workflows, such as parts of the literature review. It can find relevant papers without perfect keyword matches, summarize takeaways from the papers specific to your question, and extract key information from the papers.
* [https://elicit.org/ Elicit]: Uses language models to help you automate research workflows, such as parts of the literature review. It can find relevant papers without perfect keyword matches, summarize takeaways from the papers specific to your question, and extract key information from the papers.
* [PAI-Dashboard](https://www.pai-dashboard.com/): One-stop shop for current events, foreign policy analysis, & military news for awareness
* [https://www.pai-dashboard.com/ PAI-Dashboard]: One-stop shop for current events, foreign policy analysis, & military news for awareness
* [[Research Datasets|/topic/research/research-datasets]]: An evergreen list of datasets for research. This is not just a list of social media links but aims to provide metrics.
* [[research-datasets|Research Datasets]]: An evergreen list of datasets for research. This is not just a list of social media links but aims to provide metrics.
* [[Research Platforms|/topic/research/research-platforms]]: An evergreen list of platforms for research, specifically for gathering data.
* [[research-platforms|Research Platforms]]: An evergreen list of platforms for research, specifically for gathering data.
* If your research takes you into the DarkWeb and requires gathering data on .onion websites, then check out [[Darkweb Links|/topic/research/darkweb-links]]
* If your research takes you into the DarkWeb and requires gathering data on .onion websites, then check out [[darkweb-links|Darkweb Links]]
* [WorldCat](https://www.worldcat.org): A global catalog of library collections that helps find books, articles, and other research materials.
* [https://www.worldcat.org WorldCat]: A global catalog of library collections that helps find books, articles, and other research materials.
* [Google Dataset Search](https://datasetsearch.research.google.com): For discovering publicly available datasets.
* [https://datasetsearch.research.google.com Google Dataset Search]: For discovering publicly available datasets.
* [JSTOR](https://www.jstor.org): A digital library of academic journals, books, and primary sources.
* [https://www.jstor.org JSTOR]: A digital library of academic journals, books, and primary sources.


== Processing Data ==
== Processing Data ==
Line 68: Line 69:
=== Recommended Data Processing Resources ===
=== Recommended Data Processing Resources ===


* [Cryptpad](https://cryptpad.irregularchat.com/sheet/): For organizing and processing spreadsheet data - while being E2EE and not requiring a login
* [https://cryptpad.irregularchat.com/sheet/ Cryptpad]: For organizing and processing spreadsheet data - while being E2EE and not requiring a login
* [Microsoft Excel](https://www.microsoft.com/en-us/microsoft-365/excel): For organizing and processing spreadsheet data.
* [https://www.microsoft.com/en-us/microsoft-365/excel Microsoft Excel]: For organizing and processing spreadsheet data.
* [OSINTCombine](https://osintcombine.tools/): Process and visualize data from a local CSV file on the web without any 3rd party add-ons
* [https://osintcombine.tools/ OSINTCombine]: Process and visualize data from a local CSV file on the web without any 3rd party add-ons
* [OpenRefine](https://openrefine.org): For cleaning and transforming messy data.
* [https://openrefine.org OpenRefine]: For cleaning and transforming messy data.
* [RStudio](https://www.rstudio.com): For statistical computing and graphics, particularly useful for data analysis and visualization.
* [https://www.rstudio.com RStudio]: For statistical computing and graphics, particularly useful for data analysis and visualization.
** [[RStudio Guide|/community/guides/research/rstudio]]
** [[rstudio|RStudio Guide]]


==== Example Workflow: Building Your Own Archive ====
==== Example Workflow: Building Your Own Archive ====
See [[Archival Research|/topic/research/archival-research]] for more context
See [[archival-research|Archival Research]] for more context
# Took 27k pictures of sources
# Took 27k pictures of sources
## Sorted with exifTool by timestamp
## Sorted with exifTool by timestamp
Line 84: Line 85:
## Forensic OSINT
## Forensic OSINT
## Hunchly
## Hunchly
## [[Zotero|/topic/research/research-citation]]
## [[research-citation|Zotero]]
# Deleted Tweets
# Deleted Tweets
## Find the account
## Find the account
## [Wayback Machine Downloader](https://web.archive.org)
## [https://web.archive.org/save Wayback Machine Downloader]
# DocFetcher to create a searchable index of a directory
# DocFetcher to create a searchable index of a directory


Line 96: Line 97:
=== Recommended Data Analysis Resources ===
=== Recommended Data Analysis Resources ===


* [[Gephi Guide|/community/guides/research/gephi]] (Login Required): This is for visualizing and exploring complex networks.
* [[gephi|Gephi Guide]] (Login Required): This is for visualizing and exploring complex networks.
** [Gephi](https://gephi.org): For visualizing and exploring complex networks.
** [https://gephi.org Gephi]: For visualizing and exploring complex networks.
* [[RStudio Guide|/community/guides/research/rstudio]] (Login Required): For statistical computing and graphics, particularly useful for data analysis and visualization.
* [[rstudio|RStudio Guide]] (Login Required): For statistical computing and graphics, particularly useful for data analysis and visualization.
** [RStudio](https://www.rstudio.com): For statistical computing and graphics, particularly useful for data analysis and visualization.
** [https://www.rstudio.com RStudio]: For statistical computing and graphics, particularly useful for data analysis and visualization.
* AlternativeTo Sections: Section with multiple tools rated by the community.
* AlternativeTo Sections: Section with multiple tools rated by the community.
** [Data Visualization](https://alternativeto.net/feature/data-visualization/)
** [https://alternativeto.net/feature/data-visualization/ Data Visualization]
** [GeoSpatial Analysis](https://alternativeto.net/feature/geospatial-analysis/): Geospatial analysis tools
** [https://alternativeto.net/feature/geospatial-analysis/ GeoSpatial Analysis]: Geospatial analysis tools
* [Tableau](https://www.tableau.com): For creating interactive and shareable data visualizations.
* [https://www.tableau.com Tableau]: For creating interactive and shareable data visualizations.
* [NVivo](https://www.qsrinternational.com/nvivo-qualitative-data-analysis-software/home): For analyzing qualitative data, such as text, images, and videos.
* [https://www.qsrinternational.com/nvivo-qualitative-data-analysis-software/home NVivo]: For analyzing qualitative data, such as text, images, and videos.


By following these steps and utilizing the recommended websites and tools, researchers can effectively conduct research inspired by the Typical Intel Cycle.
By following these steps and utilizing the recommended websites and tools, researchers can effectively conduct research inspired by the Typical Intel Cycle.
Line 114: Line 115:
=== Recommended Research Report Resources ===
=== Recommended Research Report Resources ===


* [Overleaf](https://www.overleaf.com): For writing and collaborating on research papers and reports.
* [https://www.overleaf.com Overleaf]: For writing and collaborating on research papers and reports.
 
[[Category:Research]]
[[Category:Digital Footprint]]

Latest revision as of 21:47, 13 November 2024

Research Inspired by the Intel Cycle

The Typical Intel Cycle inspires organizing and conducting general research. This article outlines the four main steps of research inspired by the Cycle and provides recommendations for websites and tools to assist in each stage.


Are you starting your path to improving your research skills, especially after completing open-source research training or courses? See this community guide for ways to begin: Community Recommended Pathways/Research

Research Resources

  1. National_Strategy_and_Reports
  2. Plan and Prepare
    1. DFP for Research
  1. Research Planning Guide
  2. Structured Analytic Techniques (SATs)
  3. PMESII-PT
  4. Center of Gravity (COG) Analysis
  5. Research Templates
  1. Gather
    1. Research Datasets
    2. Darkweb Links
    3. Research Tools
    4. Leaks and Compilations
    5. Citation
    6. ai-prompting for advanced queries
  1. Process and Analyze
    1. Forms for Processing
    2. R Studio Guide

Research Guides

Image of a Typical Intel Cycle

Planning For Research

Proper planning is crucial to ensure the success of any research project. This phase involves identifying the research question or problem, formulating a hypothesis, and establishing a clear and focused research objective. This guide also includes setting up systems, networks, accounts, and devices.

See the Research Planning Guide section for a full guide.

Recommended Research Planning Resources

  • Goldilocker Tool: For refining research questions in a guided approach
  • ROOBRICK: A collaborative way to do COG Analysis with others while maintaining each planning session for knowledge management. Weights are customizable and go from 0 (lowest) to 1 (highest)
  • Mendeley: For organizing and managing references and research materials.
  • Draw.io / Diagrams.net: Create mind maps to help visualize and structure your research ideas. It does not require a login.

Gathering Data

Data collection is the next step in the research process. Researchers gather relevant information from various sources.

Recommended Data Collection Resources

  • Elicit: Uses language models to help you automate research workflows, such as parts of the literature review. It can find relevant papers without perfect keyword matches, summarize takeaways from the papers specific to your question, and extract key information from the papers.
  • PAI-Dashboard: One-stop shop for current events, foreign policy analysis, & military news for awareness
  • Research Datasets: An evergreen list of datasets for research. This is not just a list of social media links but aims to provide metrics.
  • Research Platforms: An evergreen list of platforms for research, specifically for gathering data.
  • If your research takes you into the DarkWeb and requires gathering data on .onion websites, then check out Darkweb Links
  • WorldCat: A global catalog of library collections that helps find books, articles, and other research materials.
  • Google Dataset Search: For discovering publicly available datasets.
  • JSTOR: A digital library of academic journals, books, and primary sources.

Processing Data

Once the data has been collected, it must be processed and organized for further analysis.

Recommended Data Processing Resources

  • Cryptpad: For organizing and processing spreadsheet data - while being E2EE and not requiring a login
  • Microsoft Excel: For organizing and processing spreadsheet data.
  • OSINTCombine: Process and visualize data from a local CSV file on the web without any 3rd party add-ons
  • OpenRefine: For cleaning and transforming messy data.
  • RStudio: For statistical computing and graphics, particularly useful for data analysis and visualization.

Example Workflow: Building Your Own Archive

See Archival Research for more context

  1. Took 27k pictures of sources
    1. Sorted with exifTool by timestamp
    2. OCR
  2. Tools
    1. HTTrack
    2. Forensic OSINT
    3. Hunchly
    4. Zotero
  3. Deleted Tweets
    1. Find the account
    2. Wayback Machine Downloader
  4. DocFetcher to create a searchable index of a directory

Analyzing Data

This step involves examining the processed data to identify patterns, trends, and relationships.

Recommended Data Analysis Resources

  • Gephi Guide (Login Required): This is for visualizing and exploring complex networks.
    • Gephi: For visualizing and exploring complex networks.
  • RStudio Guide (Login Required): For statistical computing and graphics, particularly useful for data analysis and visualization.
    • RStudio: For statistical computing and graphics, particularly useful for data analysis and visualization.
  • AlternativeTo Sections: Section with multiple tools rated by the community.
  • Tableau: For creating interactive and shareable data visualizations.
  • NVivo: For analyzing qualitative data, such as text, images, and videos.

By following these steps and utilizing the recommended websites and tools, researchers can effectively conduct research inspired by the Typical Intel Cycle.

Research Reporting and Dissemination

The final step in the research process involves reporting and disseminating the findings. This phase includes preparing research reports, presenting findings, and sharing insights with relevant stakeholders. Ensure the hypothesis is tested, and the results are presented clearly and concisely.

Recommended Research Report Resources

  • Overleaf: For writing and collaborating on research papers and reports.