Tuesday, January 16, 2018

Using Oracle Data Visualization for analyzing matriculation examination results in Israel - Hebrew

I used Oracle Data Visualization to do some analysis of Israeli matriculation examination results. Sorry it's all Hebrew.
The post was published here: http://www.theoracles.co.il/dv_bagrut/

Monday, December 25, 2017

OBIEE 12 with external images

In OBIEE 12 a security enhancement was made. As a result, with default installation we can't see added images based on "Image URL" (the image is empty).



 After we solve that problem we can't save the analysis with the scary note:

" Catalog object privilege validation failed for user to path XXXXXXXXX. You do not currently have sufficient privileges to save a report or dashboard page that contains HTML markup. Custom column format may contain HTML tags, only the following formats may currently be used: 'Plain text', 'Plain text (don't break spaces)'. "


For the first we should add the following 3 lines in instanceconfig.xml.
        <Security>
            <ClientSessionExpireMinutes>210</ClientSessionExpireMinutes>
            <ContentSecurityPolicy>
            <Enable>false</Enable>
            </ContentSecurityPolicy>
 

       </Security>


***** see better and secure option bellow.


For the second (saving) one more line. 
Both under the security section.


This is for version 12.2.1.3 - true value for EnableSavingContentWithHTML:
 (this option also returns the option of "Contains HTML Markup" in text object of dashboard)
         <Security>
            <ClientSessionExpireMinutes>210</ClientSessionExpireMinutes>
            <ContentSecurityPolicy>
            <Enable>false</Enable>
            </ContentSecurityPolicy>
            <EnableSavingContentWithHTML>true</EnableSavingContentWithHTML>
        </Security>

I didn't test it, but I believe this is for versions 12 under 12.2.1.3 - false value for CheckUrlFreshness:

         <Security>
            <ClientSessionExpireMinutes>210</ClientSessionExpireMinutes>
            <ContentSecurityPolicy>
            <Enable>false</Enable>
            </ContentSecurityPolicy>
            <CheckUrlFreshness>false</CheckUrlFreshness>
        </Security>
Next restart the presentation server (OBIPS)


As a result I can see images:



And the analysis can be saved.


***** a better and secure option
Following Gianni Ceresa advise, lets make it smarter. The <Enable>false<Enable> means we allow any source, and that is not very secure. It's better to allow specific sources.
For example the Pikachu picture comes from the site https://assets.pokemon.com
So I'll allow external sources only from that site. 

Instead of:

        <Security>
            <ClientSessionExpireMinutes>210</ClientSessionExpireMinutes>
            <ContentSecurityPolicy>
            <Enable>false</Enable>
            </ContentSecurityPolicy>
 

       </Security>



In ContentSecurityPolicy I will add a Directive with the value of the site.

        <Security>
            <ClientSessionExpireMinutes>210</ClientSessionExpireMinutes>
            <ContentSecurityPolicy>
                <PolicyDirectives>
                    <Directive>
                        <Name>img-src</Name>
                        <Value>https://assets.pokemon.com</Value>
                    </Directive>
                </PolicyDirectives>

            </ContentSecurityPolicy>
        </Security>

The picture that comes from URL: https://assets.pokemon.com/static2/_ui/img/chrome/external_link_bumper.png still works fine but if I try to use instead a picture of a Snorlax from the URL https://rankedboost.com/wp-content/plugins/ice/pokemon-go/Snorlax-Pokemon-Go.png it will not work:

As you might guess, it's not because OBIEE prefers Pikachu, but because I didn't allow anything from site https://rankedboost.com.
I'll add it to the Value like this:

        <Security>
            <ClientSessionExpireMinutes>210</ClientSessionExpireMinutes>
            <ContentSecurityPolicy>
                <PolicyDirectives>
                    <Directive>
                        <Name>img-src</Name>
                        <Value>https://assets.pokemon.com https://rankedboost.com</Value>
                    </Directive>
                </PolicyDirectives>

            </ContentSecurityPolicy>
        </Security>

Restart OBIPS and....


You can see a deeper dive into CSP here: https://gianniceresa.com/2016/10/google-map-in-an-obiee-12c-analysis/







Just a reminder to myself, Oracle BI12c: placing custom images in BI Server and reference using fmap from https://biapplications.wordpress.com.


Moshe, hope it helps. Best wishes for next year.

Wednesday, November 15, 2017

Data Visualization Desktop 4 what is new - part 1

Two weeks ago, Oracle released a new version of Data Visualization Desktop (DVD / DV Desktop), with lots of new options. Making it very interesting for the data analyst - data scientist spectrum.  I'll talk about it in Part 2. Lets cover some basic changes first.


My first reaction was, wow, it looks so different.

See a video by Oracle Analytics about major changes here.

A list of some of the changes:

  • It's clear we have a new home page and UI. We can customize by clicking top right corner:



  • New file based data sets can be added simply by drag and drop (beyond the regular ways):

  • New "Create" menu:






Some major changes happened in Projects.


  • The UI

  •   In previous versions there was clear difference between Visualize and Narrate. Only in Narrate we could have separate filters for each Canvas. Not anymore. Now we have the "Pin to All Canvases" filter option.


  • For each object there is a relevant properties Panel in the left corner:

(Did you notice the data type option "Number" and not "Integer" or "Double"? For updates, the original data types remain, until you change to "Number". It's not a bug).

  • We can copy/paste visualization between Canvases as well.
  • Data Action (Navigate to BI Content and Navigate to Web page, are the names in Answers). With Type options "Canvas" and "URL" and ability to open other Canvases. I hope to write a specific post about this option. Meanwhile, see a video by Oracle Analytics here.






















  • In the same Project we can have various unrelated data sources.
 
  • The Narrate option can be built by selecting Canvases. We can add notes wherever we want. It has less functionality now, and oriented for presenting a story based on Visualize components + Notes. (As a result, you might see few extra canvases in "Visualize" in upgraded projects from version 3.)

 Consider spending some time on the Narrate Properties Pane. They are several very interesting options there.

  • Date/Time columns have automatic creation of hierarchical levels. 

  • Date/Time level can be set and switched from Properties Panel at each visualization.

  •  We can show metrics as Percentage (similar to Answers Pivot)



  • Automatic Binning of metrics/measures when used as Categories (and, of course, control of the binning): 





  • The list of data sources is growing:
  1. Data Files (Excel, CSV...)
  2. Oracle Applications (Including OBIEE)
  3. Oracle Big Data Cloud (Beta)
  4. Oracle Data Warehouse Cloud (Beta)
  5. Oracle Database
  6. Oracle Content and Experience Cloud
  7. Oracle Essbase
  8. Oracle Service Cloud
  9. Oracle Talent Acquisition Cloud (Beta)
  10. Actian Ingres
  11. Actian Matrix
  12. Actian Vector
  13. Amazon Aurora
  14. Amazon EMR
  15. Amazon Redshift
  16. Apache Drill
  17. Apache Hive
  18. Cassandra
  19. DB2
  20. Dropbox
  21. Google Analytics
  22. Google Cloud
  23. Google Drive
  24. Greenplum
  25. Hortonworks Hive
  26. HP Vertica
  27.  IBM BigInsights Hive
  28. Impala
  29. Informix
  30. Map R Hive
  31. Microsoft Access
  32. MonetDB
  33. MongoDB
  34. MySQL
  35. Netezza
  36. Pivotal HD Hive
  37. PostgreSQL
  38. Presto
  39. Salesforce
  40. Spark
  41. SQL Server
  42. Sybase ASE
  43. Sybase IQ
  44. Teradata
  45. Teradata Aster
  46. Elasticsearch
  47. JDBC
  48. OData
  49. ODBC

Of course, if you have the last 3, the sky is the limit.😉




In the next post I will talk about the really interesting stuff of Explain column and Machine learning.




Sunday, November 5, 2017

Problem loading java datasource OBIEE 12.2.1.3

You are trying to load Java Datasources... with OBIEE 12.2.1.3 And get Error 404 page not found.



You see the same problem with http://YOURSERVER:9502/obiee/javads?status.

I had this problem on Windows server. probably exists on other platforms as well.

Solution:

Logon to the weblogic console (in my case http://MYSERVER:9500/console)
Select Deployments

Find there obi.datasrc.server


Find the Target tab,
Press Lock & Edit
enable bi_cluster (leave the bi_internal_virtualhost1 for next step)



Save and
Activate Changes:

Press Lock & Edit again
disable the bi_internal_virtualhost1
Save and
Activate Changes again.

(I got an error trying to do both in one step).



Now it should work: