techpppp

PowerShell - count folders in folders

2011-12-01T05:43:00.001-08:00

Counting the number of files in a directory is easy

(dir).Count

Here's a more complex example that I will break down, like a tutorial. Unlike the previous example, this is taking advantage of the object oriented nature of PowerShell. You should understand about_pipelines before you continue reading

The problem
An invoice scanning system uploads files to a file server. The directory structure is the following.
\\server\files\<country_code-invoices>\<date>\<invoice_id></invoice_id></date></country_code-invoices>

Here's an German invoice folder scanned on December 1st 2011
\\server\files\DE-invoices\2011-12-01\2ad52000-32d5-4d72-925a-98ac442d2381

The question is : "How many invoices have been created every day by country ?" . The output has to be a table to be analyzed with Excel.

The proposed solution

Get all the country folders

dir \\server\files\*-invoices

For each (% is the operator) country folder ($_ is the pipeline object), display only its name

dir \\server\files\*-invoices | %{$_.Name}
#

Display the date folders for each country

dir \\server\files\*-invoices | %{dir $_}
#

We'll store the country name in $country, to use it later as we bring it up the pipeline.

dir \\server\files\*-invoices | %{$country=$_.Name}
#

Now it's getting a bit tricky.We'll put a pipeline inside a pipeline!
Because we need to process each date folder in each country folder.

For Each country folder display its name
For Each date folder in a country folder display its name
For Each date folder, count the number of folders it contains

Display the country name and the date folder

dir \\server\files\*-invoices | %{$country=$_.Name;dir $_ |%{Write-Host $country $_.Name}}
#

outputs
DE-invoices 2011-12-01
DE-invoices 2011-11-30
etc..

Display the folder count

dir \\server\files\*-invoices | %{$country=$_.Name;dir $_ |%{Write-Host $country $_.Name (dir $_).count}}
#

outputs

DE-invoices 2011-12-01 5
DE-invoices 2011-11-30 18
etc..

The result can now be imported as CSV file ,using the space character as the separator.

Windows PowerShell : consolidate log files

2011-11-16T01:52:00.001-08:00

I'm using Windows PowerShell more and more every day, here's a simple example.

The task is to consolidate several csv files.
With command prompt

copy/b SoftDistribution*.csv Consolidated_logs.csv

With Powershell, use Get-Content and Add-Content

Get-Content SoftDistribution*.csv | Add-Content Consolidated_logs.csv

Now we have used a "text-based" approach in both cases.
In case you have headers in the .csv file, and you just want to filter out some fields of the CSV file, it will get very complicated with the command prompt.
That's when you have to take a more "object-oriented" approach with PowerShell : check out this article from Microsoft's Scripting Guy, which addresses this particular issue.

Since you can use COM and .Net objects in PowerShell, the possibilities are endless! So instead of developing a VBScript for a task we'll run one time only (not a batch), I use PowerShell interactively.

Microsoft Windows - delete a local user profile whose account is missing from AD

2011-07-04T02:41:00.000-07:00

Here's a post on how I helped my helpdesk colleagues to solve a strange problem.

John Doe's user account was deleted from Active Directory (he left the company over a year ago), but we could not delete his local profile on a Windows Server 2003:

through the user profiles control panel, it is not present
deleting the folder in "c:\documents and settings" said ntuser.dat is in use
The "User Profile Deletion Utility" (delprof) from Windows Server 2003 Resource Kit Tools doesn't find this profile either.

I checked with "Process Explorer" and saw his ntuser.dat was loaded.

NTUSER.DAT is a file containing the user's registry hive. it is loaded in the machine-wide registry under HKEY_USERS.

So we need to unload this user's registry hive, in order to delete his profile in "c:\document and settings"

You need to find out which SID (the S-1-5-21 ..etc) correspond to this user
So check the loaded hives in HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Control\hivelist

Then go back to HKEY_USERS , select the SID and go to file > unload hive.
You should now be able to delete his profile in "c:\documents and settings"

SCCM Metering query

2011-05-26T07:21:00.000-07:00

UPDATE 04/10/2011: the main query ("query_metering_data") has been changed, so that it even displays computers with no metering data

In a multinational company,you have to be ready for a software audit.

The people in charge of license control go mad when they realise you have 500 computers with Microsoft Visio Professional, when you are licensed for only 450 copies !
Then you have to find 50 users which have it installed but don't need it. If you ask them , they will all say they use it every day :-)

Software Metering in Configuration Manager is extensively covered on the web, so I will spare you the introduction.

Using SCCM, I wanted to uninstall unused software on PCs automatically, based on Software Metering data.
This can be done and is covered in forums, but my customer wanted to first check who was scheduled for removal. Imagine if you uninstalled Microsoft Project Standard from the laptop of the vice president of IT !

I developped a VB.NET application which is centered around a DataGridView, the data source being the SCCM SQL database server. Here's an overview.

First, list all the metering rules

Dim query_rules As String = "select productname from v_MeterRuleInstallBase" & _
  " GROUP BY productname ORDER BY productname"

Double clicking a metering rule displays the metering data for this metering rule, for the collection specified.
Now here's the core of this : the SQL query to make sense of the metering data.

Dim query_metering_data = "select sys.Name0 AS Name,sys.User_Name0,mru.MeteredFileID,mru.ResourceId,MAX(TimeKey) As TimeKey, MAX(LastUsage) AS 'LastUsage' , MAX(lastseen.LastHWScan) AS 'Last hardware scan',sf.FilePath" & _
            " from v_MeterRuleInstallBase mru" & _
            " LEFT JOIN v_MonthlyUsageSummary mus ON (mru.MeteredFileID = mus.FileID AND mru.ResourceID = mus.ResourceID)" & _
            " JOIN v_r_system sys ON mru.ResourceID = sys.ResourceID" & _
            " JOIN v_GS_WORKSTATION_STATUS lastseen ON mru.ResourceID = lastseen.ResourceID" & _
            " JOIN v_fullcollectionmembership m ON mru.ResourceID = m.ResourceID" & _
            " JOIN v_GS_Softwarefile sf ON m.ResourceID = sf.ResourceID AND mru.meteredFileID = sf.FileID" & _
            " WHERE mru.ProductName = '" & Metering_rule & "'" & _
            " AND m.CollectionID = '" & TextBox_CollectionID.Text & "'" & _
            " GROUP BY sys.Name0,sys.User_Name0,mru.MeteredFileID,mru.ResourceID,sf.FilePath" & _
            " ORDER BY sys.Name0"

I've added a right click menu to remove false positives (like the $PatchCache$ path ). The list can be sorted by any column desired.

Ensuring the last hardware scan is recent tells you the client looks OK
The FilePath is helpful, we found people using portable applications run from USB stick were metered!
Sort by "Last Usage" to find who has not used it the metered software for a long time.
The desired cells can be copied to excel, or directly as Comma Separated Values with the "Copy to clipboard as CSV"

My customer uses a list of computers as a CSV file, to assign an uninstall program. This required another tool (which is not covered in this post).

SCCM Package replication status gadget for Windows 7 Sidebar

2011-01-04T08:02:00.000-08:00

Making sure your packages are replicating correctly in your SMS hierarchy is important.
Sometimes, you even want to know as soon as possible when a package has been replicated!
This has been useful when a new office is being build far away, and I want to inform the fields technicians on site when they'll be allowed to push out software.

Therefore, I present the "PackageStatusDetailSummarizer" gadget for Windows 7 Sidebar!

>>DOWNLOAD<<

It's like the "Package Status" view in the "Configuration Manager Console", just neater in a gadget :-)

Inspiration from

"Software Updates" gadget of the Configuration Manager SDK Samples
The WMI class SMS_PackageStatusDetailSummarizer from the SMS SDK
Windows Sidebar
Windows Sidebar Object Reference

To install in Windows 7:

drop the folder "PackageStatusDetailSummarizer.Gadget" in %userprofile%\appdata\Local\Microsoft\Windows Sidebar
right click on your desktop, choose "Gadgets", you should see it in the list

right click, "install"
configure by setting the options, just like a normal gadget
Be careful with the refresh interval in the options, if you set it to low you can hurt your site's performance.

If you want to customize it,just close the gadget and edit the files in the folder you have copied (see the "Windows Sidebar" link)
The possibilites are endless : check the deployment of packages,advertisements, software updates, site health etc..

Testing Aixiz lasers

2010-10-01T09:51:00.000-07:00

I bought some infrared lasser from Aixiz to build an interactive multitouch surface.
To avoid any damage to my eyes, I was wearing Infrared protection glasses from Dragon Lasers

Now, the thing that I hadn't planned was how to power the lasers :-)
As they are rated at 3.2VDC, drawing approximately 30ma of current, this seems something my Arduino Duemilanovae could do.

Connect the Arduino to the USB port of the computer
Connect an infared camera to the computer ( here using a modified PS3eye with a 850nm filter - same wavelength as the lasers)
Position the camera, and launch a viewer (here using the CL-Eye Test from Code Laboratories )
Put the protection glasses on, close all doors & windows to the room you're in (and you are alone right!)
Hook up a laser to the Arduino: red cable on the "3v3" , black cable on "Gnd"
You should now see the laser beaming (or not) through the viewer

Repeat for all the lasers you ordered to make sure they are all working properly...and give a good feedback to Aixiz if you bought your lasers from their eBay store

You can see a bit of the laser in this picture because a picture camera will see infrared (whereas your eyes cannot).
Now I have to find something to power 4 lasers at the same time (something I'm not sure the Arduino can do)

Google Goggles: What's this thing with no name on it?

2010-09-15T09:24:00.000-07:00

Every time I came home, I wondered what was this thing nailed to the wall in the hall of my building.

I couldn't anything written on it either. And I didn't want to take it off to read the back of it.
All I could make out of it was this logo on it.

Enter "Google Goggles"
Install it on your Android phone, then snap a picture with Google Goggles.

That's how I found out that this was some kind of Ubiquiti Wifi bridge. Just by taking a picture of the logo.
I opened a maintenance closet in the staircase, and found a Power-over-ethernet module to power this device, along with an ethernet cable running one floor up.
Someone running a big wifi network around here ;-)

SCCM : converting programs to Windows 7

2010-09-14T09:32:00.000-07:00

This is a VBS program I wrote for a customer, who has a SCCM 2007 R2 environment.

They had over 400 programs in various packages, and they weren't sure if all of them would run under Windows 7.

Visually, we had to make sure this box was ticked.

After a little digging in the SCCM SDK (link), and a script from Stuart James, the following will go through ALL programs in ALL packages. If a program is not set to "Run on all platforms", we add that it can run on "All x86 Windows 7"

It outputs changes with comma separated values (csv) so you can send this to a file and dress it up nice in Excel for your boss :-)

'===================================== 
'SetRunFromTS - Sets all programs to be able to run in Windows 7 x86
'Author: Patrick Paumier / Stuart James 
' 
'Requirements: Change line 22 to connect to your site server
' 
'Usage: CScript xxx.vbs or double click 
'===================================== 


'Check we're using CScript and if not then relaunch 
If "CSCRIPT.EXE" <> UCase(Right(WScript.Fullname, 11)) Then 
Set WshShell = WScript.CreateObject("WScript.Shell") 
WshShell.Run "CSCRIPT.EXE /nologo " & WScript.ScriptFullName 
Wscript.Quit 
End If 

' Setup a connection to the local provider. 
Set swbemLocator = CreateObject("WbemScripting.SWbemLocator") 
Set swbemServices= swbemLocator.ConnectServer("MY-SCCM-SERVER", "root\sms") 
Set providerLoc = swbemServices.InstancesOf("SMS_ProviderLocation") 

For Each Location In providerLoc 
If location.ProviderForLocalSite = True Then 
Set swbemServices = swbemLocator.ConnectServer(Location.Machine, "root\sms\site_" + Location.SiteCode) 
Exit For 
End If 
Next 

'Main call 
QueryPrograms swbemServices 

Sub QueryPrograms(connection) 

On Error Resume next 

Dim programs 
'Dim program 
' Run the query. 
Set programs = connection.ExecQuery("Select * From SMS_Program WHERE PackageID='TDE0024F'") 

If Err.Number<>0 Then 
Wscript.Echo "Couldn't get programs" 
Wscript.Quit 
End If 
For Each program In programs 
ModifyProgram connection,program.PackageID, program.ProgramName 
Next 
If programs.Count=0 Then 
Wscript.Echo "No packages found" 
End If 

End Sub 

Sub ModifyProgram (connection, existingPackageID, existingProgramName) 

' Build a query to get the specified package. 
packageQuery = "SMS_Package.PackageID='" & existingPackageID & "'" 

' Run the query to get the package. 
Set package = connection.Get(packageQuery) 
' Output package name and ID. 
wscript.echo VBCrLf 'New Line
Wscript.StdOut.Write package.PackageID & "," 'Package ID
Wscript.StdOut.Write package.Name & "," 'Package Name
' Build a query to get the programs for the package. 
programQuery = "SELECT * FROM SMS_Program WHERE PackageID='" & existingPackageID & "'" 
' Run the query to get the programs. 
Set allProgramsForPackage = connection.ExecQuery(programQuery, , wbemFlagForwardOnly Or wbemFlagReturnImmediately) 
'The query returns a collection of program objects that needs to be enumerated. 
For Each program In allProgramsForPackage                
If program.ProgramName = existingProgramName Then 
'Get all program object properties (in this case we specifically need some lazy properties).
programPath = program.Put_
Set program = connection.Get(programPath) 

' Output the program name 
Wscript.StdOut.Write program.ProgramName & "," ' Program Name
Wscript.StdOut.Write program.ProgramFlags & "," 'Program Flags

If program.ProgramFlags AND 2^27 Then
Wscript.StdOut.Write "OK for all platforms"
Else
' RUN_ON_SPECIFIED_PLATFORMS is set.
Win7OK = FALSE
For Each myOS in program.SupportedOperatingSystems
osver = Left(myOS.MinVersion,3)
If osver="6.1" And myOS.Platform="I386" Then
Wscript.StdOut.Write "OK for Windows 7" ' Name: " & myOS.Name & " MinVersion: "& myOS.MinVersion & " MaxVersion: " & myOS.MaxVersion & " Platform: " & myOS.Platform
Win7OK = TRUE
Exit For
End If
Next
If Win7OK = FALSE Then
'Add Windows 7 32bit platform
' Create 
Set tempSupportedPlatform = connection.Get("SMS_OS_Details").SpawnInstance_
' Populate tempSupportedPlatform values.    
tempSupportedPlatform.MaxVersion = "6.10.9999.9999"
tempSupportedPlatform.MinVersion = "6.10.0000.0"
tempSupportedPlatform.Name       = "Win NT"
tempSupportedPlatform.Platform   = "I386"

' Get the array of supported operating systems.
tempSupportedPlatformsArray = program.SupportedOperatingSystems   

' Add the new supported platform values (object) to the temporary array.
ReDim Preserve tempSupportedPlatformsArray (Ubound(tempSupportedPlatformsArray) + 1)
Set tempSupportedPlatformsArray(Ubound(tempSupportedPlatformsArray)) = tempSupportedPlatform

' Replace the SupportedOperatingSystems object array with the new updated array.
program.SupportedOperatingSystems = tempSupportedPlatformsArray

' Save the program.
program.Put_

' Output success message.

Wscript.StdOut.Write "Added Win7"
End If
End If
End If        
Next 
End Sub

SyntaxHighlighter with Blogger

2010-09-11T13:15:00.000-07:00

I've been away from Blogger for a while, and I'm happy it got some new templates.
I've implemented a syntax highlighter to better view code, it's called SyntaxHighlighter.
Here are the steps to use it on Blogger

Download SyntaxHighlighter to your computer
Create a "Google Site" if you don't have one yet
Create a "File Cabinet" page
Upload the "shcore.js", the css files and the brushes (=code highlights for specific languages) as described in the SyntaxHighlighter installation notes
Edit your Blogger template, link the js files and css in to the files you've uploaded (copy the link from "Download" on the file cabinet)
Use the 'pre' method as described in the installation notes
Don't forget the inclusion of SyntaxHighlighter.all()

2010-01-27T13:04:00.000-08:00

As part of a job interview, I was asked to program a VB script.

The goal was to:
"Disable LAN,WAN,Bluetooth devices as soon as any user (except shopAdmin) makes a login to the Computer (VB).
Hint this is only possible with the extra software piece called Devcon"

How do I start?

search on the internet to see if someone else did it. If I judge it's well done, why reinvent what has already been invented?
search in my scripts if I've already done it or part of it. Most likely, I will reuse generic scripts I made.

In this case, the "hint" meant that since a command line program would be used, some string parsing would be involved. A few Google searches turned up some ideas but nothing as complete as what was requested.

'Assuming devcon is the WINDOWS folder
'Assuming the logged on user has the right to disable devices.

LANadapter = "Broadcom Loca Network Adapter"
BTadapter = "BT adapter"
WLANadapter = "Dell Wireless 1470 Dual Band WLAN Mini-PCI Card"

Set objShell = WScript.CreateObject("WScript.Shell")

Set objNet = CreateObject("WScript.NetWork")

If Not objNet.UserName = "shopAdmin" Then
Set objExecObject = objShell.Exec("cmd /c devcon listclass Net")

Do While Not objExecObject.StdOut.AtEndOfStream

strText = objExecObject.StdOut.ReadLine()

If Instr(strText,LANadapter)>0 Then
ID = Split(strText,"\",3)
Set objExecObject = objShell.Exec("cmd /c devcon.exe disable " & ID(0) & "\" & ID(1) )
WScript.Echo "LAN disabled"

ElseIf Instr(strText,BTadapter )>0 Then
ID = Split(strText,"\",3)
Set objExecObject = objShell.Exec("cmd /c devcon.exe disable " & ID(0) & "\" & ID(1) )
WScript.Echo "Bluetooth disabled"

ElseIf Instr(strText,WLANadapter)>0 Then
ID = Split(strText,"\",3)
Set objExecObject = objShell.Exec("cmd /c devcon.exe disable " & ID(0) & "\" & ID(1) )
WScript.Echo "WLAN disabled"
End If

Loop
End If

Multi touch table - MT Crayon Physics

2009-10-26T16:24:00.000-07:00

I've been building a multi touch table as a side project for a year. Since I haven't had a job for a few months, I found the time to bring this to near completion !

For the technical details

what you are seeing is MTCrayonphysics
the physical setup is "Rear Diffused Illumination"
blob tracking is Community Core Vision 1.2

I'd like to thank the NUI Group community for all their valuable tips.

A simple application with Processing

2009-09-29T07:51:00.000-07:00

I am a big fan of Processing . I will show you a simple application I programmed with it.

As described by the website, it is:
Processing is an open source programming language and environment for people who want to program images, animation, and interactions. It is used by students, artists, designers, researchers, and hobbyists for learning, prototyping, and production. It is created to teach fundamentals of computer programming within a visual context and to serve as a software sketchbook and professional production tool. Processing is an alternative to proprietary software tools in the same domain.

If you don't know how to program, this is a great way to learn, as you can get quick, gratifying results. The latter is very important.
A lot of people give up making their own programs because of the considerable amount of time and things they have to learn before creating something.

If you already know how to program, but you don't practice at work, it will feel great to walk in familiar shoes ! As it's based on Java, you can forget the nightmares you had with other languages like C (pointers..arrr my head hurts!).
I mastered Object Oriented Programming, thanks to Processing ! Also I understood a lot more about computer animation, graphics, how they are rendered...and then you can start doing your own.
You can move on to faster or more complete development environment once you feel confortable. Because, truth be told, the C language is much faster than Processing/Java.

Enough ranting, here is my program, followed by step by step explanations.

String path1,path2;
PImage p1,p2;

void setup(){
size(640,480);
String path1 = selectInput();
p1 = loadImage(path1,"jpg");
p1.resize(width,height);
image(p1,0,0);

String path2 = selectInput();
p2 = loadImage(path2,"jpg");
p2.resize(width,height);
}
void draw(){
if (mousePressed ==true && (mouseButton == LEFT)){
copy(p2,mouseX,mouseY,20,20,mouseX,mouseY,20,20);
}
}

You should download Processing, unzip it,launch it, then paste the code into it.
Just hit the play button. You will be asked twice for a file. Choose two different pictures, JPG format. Click around the picture, drag...
You will then understand what this application is about!

Step by step
First, you need the variables to play with: 2 pieces of text ("String") to hold the path to the images, and 2 images ("PImage") to hold the images themselves.

String path1,path2;
PImage p1,p2;

In Processing, you get your stuff ready in the "void setup()" section, before everything starts happening in the "void draw()" section. Note that they are delimited by brackets.

size sets the size of the application to 640 pixels by 480 pixels.
selectInput calls the dialog to choose a file and stores its path in "path1"
loadImage loads the image into memory, into the "p1" PImage variable.
resize set the size of the "p1" Pimage to the "width" and "height" of the application - we stated these previously with size(). Otherwise, the image you've chosen with selectInput might be too big or too small.
image displays "p1" inside the application window.

We do the same thing for the second picture..but we keep it into memory without displaying it. Yes, you have noticed we are not using image() on this one !

void setup(){
size(640,480);
String path1 = selectInput();
p1 = loadImage(path1,"jpg");
p1.resize(width,height);
image(p1,0,0);

String path2 = selectInput();
p2 = loadImage(path2,"jpg");
p2.resize(width,height);
}

Now the action starts. The code in "void draw()" is run 60 times per second! This rate is called 60 FPS - frames per second.
So what am I doing for EACH FRAME?
I'm checking if it's true that the mouse button is pressed, and if it's the LEFT mouse button.
In this case, I'll call the "copy()" function. Let's detail this just after the code.

void draw(){
if (mousePressed ==true && (mouseButton == LEFT)){
copy(p2,mouseX,mouseY,20,20,mouseX,mouseY,20,20);
}
}

From the reference :
"[..]copies a region of pixels from an image used as the srcImg parameter into the display window.[..]"

So, I am copying a part of the second image("p2"). Actually, I am copying from the same place you clicked - mouseX and mouseY represent the coordinates of the click.
And the size of the block being copied is 20 pixels by 20 pixels.
After copying the bit I wanted, I'm "pasting" it at the same coordinates, the same size.

copy(p2,mouseX,mouseY,20,20,mouseX,mouseY,20,20);

Think this one thoroughly, keep the application open with the code and the reference.....concentrate !
This line might be the hardest to grasp for newbies, but if you understood this, your imagination can now run wild !
If you want to go further or have an easier start,
do have a look at the Processing website, the reference always comes with examples, or you can go through the tutorials.
More advanced libraries can help you achieve anything : music,3D, animation, movie editing, real time video editing, playing with network and the web, etc, etc....

Or you can just peek at the Exhibition or the eye candy at OpenProcessing

Starting with Blogger

2009-03-29T16:46:00.000-07:00

I started this to make eventually a diary of these little experiments in coding and systems.
These are mostly in Microsoft Windows environments, as this is what I use at work.

First I had to customize the Blogger template
http://bguide.blogspot.com/2008/02/three-column-templates-explained.html

I had to test my HTML changes in real time to test quickly
http://htmledit.squarefree.com/

Color names for CSS were needed too
http://www.w3schools.com/css/css_colornames.asp

Escape HTML . I needed to post HTML code samples without Blogger interpreting them
http://www.accessify.com/tools-and-wizards/developer-tools/quick-escape/