Run batch on a collection of images


#1

Maybe I’m not seeing something, but is there a way to run a single filter on a collection of different images?


#2

What OS (why do people never say?)

At present on Windows you can use the CLI to manually build a batch file. Actually this is possible on all versions of DAE with some messing around.

On Windows the comman looks something like this…

c:\dae\DeepArtEffectsCli.exe artfilter -input “c:\dae\cli\chosen-bloke2.jpg” -output “c:\dae\cli\0001-chosen-bloke2.jpg” -stylename “photography”

That takes the input image and creates the output image using the style ‘stylename’

At the most mundane level all you need is to copy the one line and change the input and output filenames - that’s rather time consuming of course.

If you google something like “process a directory of files windows batch” you’ll get some pointers in the right direction

I’m in the process of releasing a DAE speed-up program (make it 2-4 times as fast on the CPU version) and after that intend to write a fully featured front end to DAE that does things like process a load of images all at once

Keep your eyes on https://peardox.com for updates


#3

@joelnisson

Done the release of my “Make DAE go faster program” - had a last moment hiccup with the Linux version so ended up putting that one on hold for a day or two.

Think I’ll play with batch processing soon as you and I are not the only ones who want this.

Mac or Windows then?


#4

I suspect that there are others who would like to batch process collections of images. The command line technique is just a bit cumbersome for me, especially for processing lots of images. I thank you in advance for your doing it whenever that is.

I use both Mac and Windows, but my current Windows machine is much faster than my aging Mac Pro, so I’ll vote for a Win version (Win 10).

Thanks.
–Joel


#5

I’ll be doing exactly the same stuff the command-line version does, I’m just going to slap a GUI over the whole process to hide what’s going on behind the scenes :slight_smile:

Mac Pro or MacBook Pro?

If a Mac Pro - one of the Dustbin models or older than that? I fancy trying to get StartDAE working on that!

I’ve got a MacBook Pro Late 2013.

Fancy helping me out a little?

Click the Apple symbol in the top left hand of the screen then ‘About this Mac’ - that’ll give me basic info about the machine.

Then can you download https://software.intel.com/en-us/download/download-maccpuid for the Mac then click File -> Save To File the results and email it to [email protected]

This will let me build a StartDAE specific you your model of Mac - I strongly suspect that there will be a change in the speed.

I’ll be building this stuff into th next StartDAE - CPUID is a quick work-around


#6

Sure, I would be glad to help. (I had sent you an email on your site asking for a direct email address, but this will probably do fine.) I should say that if and when you develop your GUI for DAE batch processing, I personally would much prefer a Windows version. My Mac Pro desktop is a mid-2010 and getting very long in the tooth, even though I did upgrade the graphics card last year. My Windows machine is brand new. I built it myself last year and it is several times faster than my Mac (which I still love just for the OS).

Here is the “about this Mac” display.
image

I couldn’t attach the MacCPUID file to this email for some reason, but here is a paste of its contents:
MacCPUID v3.1

Info
CPU Model: Intel® Xeon® CPU W3680 @ 3.33GHz
Genuine? YES
Architecture: Westmere - 1st Generation Intel Core
Family: 6 (06h)
Model: 44 (2Ch)
Stepping: 2 (02h)
Frequency: 3,333,332 (Hz)
Invariant TSC? NO
GPU Model(s): AMD Radeon HD 7xxx

Features
ACPI
Supported? YES
CPUID: (EAX=01h, ECX=0):EDX[22]
ADX
Supported? NO
CPUID: (EAX=07h, ECX=0):EBX[19]
AES
Supported? YES
CPUID: (EAX=01h, ECX=0):ECX[25]
APIC
Supported? YES
CPUID: (EAX=01h, ECX=0):EDX[9]
AVX
Supported? NO
CPUID: (EAX=01h, ECX=0):ECX[28]
AVX2
Supported? NO
CPUID: (EAX=07h, ECX=0):EBX[5]
AVX512BW
Supported? NO
CPUID: (EAX=07h, ECX=0):EBX[30]
AVX512CD
Supported? NO
CPUID: (EAX=07h, ECX=0):EBX[28]
AVX512DQ
Supported? NO
CPUID: (EAX=07h, ECX=0):EBX[17]
AVX512ER
Supported? NO
CPUID: (EAX=07h, ECX=0):EBX[27]
AVX512F
Supported? NO
CPUID: (EAX=07h, ECX=0):EBX[16]
AVX512IFMA
Supported? NO
CPUID: (EAX=07h, ECX=0):EBX[21]
AVX512PF
Supported? NO
CPUID: (EAX=07h, ECX=0):EBX[26]
AVX512VBMI
Supported? NO
CPUID: (EAX=07h, ECX=0):ECX[1]
AVX512VL
Supported? NO
CPUID: (EAX=07h, ECX=0):EBX[31]
AVX512_4FMAPS
Supported? NO
CPUID: (EAX=07h, ECX=0):EDX[3]
AVX512_4VNNIW
Supported? NO
CPUID: (EAX=07h, ECX=0):EDX[2]
AVX512_BITALG
Supported? NO
CPUID: (EAX=07h, ECX=0):ECX[12]
AVX512_VBMI2
Supported? NO
CPUID: (EAX=07h, ECX=0):ECX[6]
AVX512_VNNI
Supported? NO
CPUID: (EAX=07h, ECX=0):ECX[11]
AVX512_VPOPCNTDQ
Supported? NO
CPUID: (EAX=07h, ECX=0):ECX[14]
BMI1
Supported? NO
CPUID: (EAX=07h, ECX=0):EBX[3]
BMI2
Supported? NO
CPUID: (EAX=07h, ECX=0):EBX[8]
CLDEMOTE
Supported? NO
CPUID: (EAX=07h, ECX=0):ECX[25]
CLFLUSHOPT
Supported? NO
CPUID: (EAX=07h, ECX=0):EBX[23]
CLFSH
Supported? YES
CPUID: (EAX=01h, ECX=0):EDX[19]
CLWB
Supported? NO
CPUID: (EAX=07h, ECX=0):EBX[24]
CMOV
Supported? YES
CPUID: (EAX=01h, ECX=0):EDX[15]
CNXT_ID
Supported? NO
CPUID: (EAX=01h, ECX=0):ECX[10]
CX16
Supported? YES
CPUID: (EAX=01h, ECX=0):ECX[13]
CX8
Supported? YES
CPUID: (EAX=01h, ECX=0):EDX[8]
DCA
Supported? YES
CPUID: (EAX=01h, ECX=0):ECX[18]
DE
Supported? YES
CPUID: (EAX=01h, ECX=0):EDX[2]
DEPRECATE_FPU_CS_DS
Supported? NO
CPUID: (EAX=07h, ECX=0):EBX[13]
DS
Supported? YES
CPUID: (EAX=01h, ECX=0):EDX[21]
DS_CPL
Supported? YES
CPUID: (EAX=01h, ECX=0):ECX[4]
DTES64
Supported? YES
CPUID: (EAX=01h, ECX=0):ECX[2]
EM64T
Supported? YES
CPUID: (EAX=80000001h, ECX=0):EDX[29]
ERMS
Supported? NO
CPUID: (EAX=07h, ECX=0):EBX[9]
EST
Supported? YES
CPUID: (EAX=01h, ECX=0):ECX[7]
FDP_EXCPTN_ONLY
Supported? NO
CPUID: (EAX=07h, ECX=0):EBX[6]
FMA
Supported? NO
CPUID: (EAX=01h, ECX=0):ECX[12]
FP16C
Supported? NO
CPUID: (EAX=01h, ECX=0):ECX[29]
FPU
Supported? YES
CPUID: (EAX=01h, ECX=0):EDX[0]
FSGSBASE
Supported? NO
CPUID: (EAX=07h, ECX=0):EBX[0]
FXSR
Supported? YES
CPUID: (EAX=01h, ECX=0):EDX[24]
Fast Short REP MOV
Supported? NO
CPUID: (EAX=07h, ECX=0):EDX[4]
GFNI
Supported? NO
CPUID: (EAX=07h, ECX=0):ECX[8]
HLE
Supported? NO
CPUID: (EAX=07h, ECX=0):EBX[4]
HTT
Supported? YES
CPUID: (EAX=01h, ECX=0):EDX[28]
INVPCID
Supported? NO
CPUID: (EAX=07h, ECX=0):EBX[10]
INVTSC
Supported? NO
CPUID: (EAX=80000007h, ECX=0):EDX[8]
IPT
Supported? NO
CPUID: (EAX=07h, ECX=0):EBX[25]
LAHFSAHF
Supported? YES
CPUID: (EAX=80000001h, ECX=0):ECX[0]
LZCNT
Supported? NO
CPUID: (EAX=80000001h, ECX=0):ECX[5]
MCA
Supported? YES
CPUID: (EAX=01h, ECX=0):EDX[14]
MCE
Supported? YES
CPUID: (EAX=01h, ECX=0):EDX[7]
MMX
Supported? YES
CPUID: (EAX=01h, ECX=0):EDX[23]
MONITOR
Supported? YES
CPUID: (EAX=01h, ECX=0):ECX[3]
MOVBE
Supported? NO
CPUID: (EAX=01h, ECX=0):ECX[22]
MOVDIR64B
Supported? NO
CPUID: (EAX=07h, ECX=0):ECX[28]
MOVDIRI
Supported? NO
CPUID: (EAX=07h, ECX=0):ECX[27]
MPX
Supported? NO
CPUID: (EAX=07h, ECX=0):EBX[14]
MSR
Supported? YES
CPUID: (EAX=01h, ECX=0):EDX[5]
MTRR
Supported? YES
CPUID: (EAX=01h, ECX=0):EDX[12]
OSPKE
Supported? NO
CPUID: (EAX=07h, ECX=0):ECX[4]
OSXSAVE
Supported? NO
CPUID: (EAX=01h, ECX=0):ECX[27]
PAE
Supported? YES
CPUID: (EAX=01h, ECX=0):EDX[6]
PAGE1GB
Supported? YES
CPUID: (EAX=80000001h, ECX=0):EDX[26]
PAT
Supported? YES
CPUID: (EAX=01h, ECX=0):EDX[16]
PBE
Supported? YES
CPUID: (EAX=01h, ECX=0):EDX[31]
PCID
Supported? YES
CPUID: (EAX=01h, ECX=0):ECX[17]
PCLMULQDQ
Supported? YES
CPUID: (EAX=01h, ECX=0):ECX[1]
PDCM
Supported? YES
CPUID: (EAX=01h, ECX=0):ECX[15]
PGE
Supported? YES
CPUID: (EAX=01h, ECX=0):EDX[13]
PKU
Supported? NO
CPUID: (EAX=07h, ECX=0):ECX[3]
POPCNT
Supported? YES
CPUID: (EAX=01h, ECX=0):ECX[23]
PREFETCHW
Supported? NO
CPUID: (EAX=80000001h, ECX=0):ECX[8]
PREFETCHWT1
Supported? NO
CPUID: (EAX=07h, ECX=0):ECX[0]
PSE
Supported? YES
CPUID: (EAX=01h, ECX=0):EDX[3]
PSE36
Supported? YES
CPUID: (EAX=01h, ECX=0):EDX[17]
PSN
Supported? NO
CPUID: (EAX=01h, ECX=0):EDX[18]
RDPID
Supported? NO
CPUID: (EAX=07h, ECX=0):ECX[22]
RDRAND
Supported? NO
CPUID: (EAX=01h, ECX=0):ECX[30]
RDSEED
Supported? NO
CPUID: (EAX=07h, ECX=0):EBX[18]
RDTSCP
Supported? YES
CPUID: (EAX=80000001h, ECX=0):EDX[27]
RDT_A
Supported? NO
CPUID: (EAX=07h, ECX=0):EBX[15]
RDT_M
Supported? NO
CPUID: (EAX=07h, ECX=0):EBX[12]
RTM
Supported? NO
CPUID: (EAX=07h, ECX=0):EBX[11]
SDBG
Supported? NO
CPUID: (EAX=01h, ECX=0):ECX[11]
SEP
Supported? YES
CPUID: (EAX=01h, ECX=0):EDX[11]
SGX
Supported? NO
CPUID: (EAX=07h, ECX=0):EBX[2]
SGX_LC
Supported? NO
CPUID: (EAX=07h, ECX=0):ECX[30]
SHA
Supported? NO
CPUID: (EAX=07h, ECX=0):EBX[29]
SMAP
Supported? NO
CPUID: (EAX=07h, ECX=0):EBX[20]
SMEP
Supported? NO
CPUID: (EAX=07h, ECX=0):EBX[7]
SMX
Supported? YES
CPUID: (EAX=01h, ECX=0):ECX[6]
SS
Supported? YES
CPUID: (EAX=01h, ECX=0):EDX[27]
SSE
Supported? YES
CPUID: (EAX=01h, ECX=0):EDX[25]
SSE2
Supported? YES
CPUID: (EAX=01h, ECX=0):EDX[26]
SSE3
Supported? YES
CPUID: (EAX=01h, ECX=0):ECX[0]
SSE4_1
Supported? YES
CPUID: (EAX=01h, ECX=0):ECX[19]
SSE4_2
Supported? YES
CPUID: (EAX=01h, ECX=0):ECX[20]
SSSE3
Supported? YES
CPUID: (EAX=01h, ECX=0):ECX[9]
SYSCALLRET
Supported? YES
CPUID: (EAX=80000001h, ECX=0):EDX[11]
TM
Supported? YES
CPUID: (EAX=01h, ECX=0):EDX[29]
TM2
Supported? YES
CPUID: (EAX=01h, ECX=0):ECX[8]
TSC
Supported? YES
CPUID: (EAX=01h, ECX=0):EDX[4]
TSC_ADJUST
Supported? NO
CPUID: (EAX=07h, ECX=0):EBX[1]
TSC_DEADLINE
Supported? NO
CPUID: (EAX=01h, ECX=0):ECX[24]
UMIP
Supported? NO
CPUID: (EAX=07h, ECX=0):ECX[2]
VAES
Supported? NO
CPUID: (EAX=07h, ECX=0):ECX[9]
VME
Supported? YES
CPUID: (EAX=01h, ECX=0):EDX[1]
VMX
Supported? YES
CPUID: (EAX=01h, ECX=0):ECX[5]
VPCLMULQDQ
Supported? NO
CPUID: (EAX=07h, ECX=0):ECX[10]
WAITPKG
Supported? NO
CPUID: (EAX=07h, ECX=0):ECX[5]
X2APIC
Supported? NO
CPUID: (EAX=01h, ECX=0):ECX[21]
XD
Supported? YES
CPUID: (EAX=80000001h, ECX=0):EDX[20]
XG1
Supported? NO
CPUID: (EAX=0dh, ECX=1):EAX[2]
XSAVE
Supported? NO
CPUID: (EAX=01h, ECX=0):ECX[26]
XSAVEC
Supported? NO
CPUID: (EAX=0dh, ECX=1):EAX[1]
XSAVEOPT
Supported? NO
CPUID: (EAX=0dh, ECX=1):EAX[0]
XSS
Supported? NO
CPUID: (EAX=0dh, ECX=1):EAX[3]
XTPR
Supported? YES
CPUID: (EAX=01h, ECX=0):ECX[14]

Cache
Caches
L1 Data
Size: 32KB
Associativity: 8
Line Size: 64B
Max Threads: 2
Mapping: Direct
Inclusive: No
Invalidates Lower Caches: Yes
L1 Instruction
Size: 32KB
Associativity: 4
Line Size: 64B
Max Threads: 2
Mapping: Direct
Inclusive: No
Invalidates Lower Caches: Yes
L2 Unified
Size: 256KB
Associativity: 8
Line Size: 64B
Max Threads: 2
Mapping: Direct
Inclusive: No
Invalidates Lower Caches: Yes
L3 Unified
Size: 12MB
Associativity: 16
Line Size: 64B
Max Threads: 32
Mapping: Direct
Inclusive: Yes
Invalidates Lower Caches: No
Cache Info
Data TLB0: 2 MByte and 4 MByte pages, 4-way set associative, 32 entries
Data TLB: 4 KByte Pages, 4-way set associative, 64 entries
Instruction TLB: 2-MByte or 4-MByte pages, fully associative, 7 entries
CPUID leaf 2 does not report cache descriptor information, use CPUID leaf 4 to query cache parameters
Instruction TLB: 4 KByte Pages, 4-way set associative, 64 entries
64-Byte Prefetching
Shared 2nd-Level TLB: 4 KByte pages, 4-way associative, 512 entries
CLFLUSH Line Size: 64

Performance
Version: 3
General-Purpose Counters
Number: 4
Width (bits): 48
Fixed-Function Counters
Number: 3
Width (bits): 48
Events
Core Cycles
Supported? YES
Instructions Retired
Supported? YES
Reference Cycles
Supported? NO
Last-Level Cache Reference
Supported? YES
Last-Level Cache Misses
Supported? YES
Branch Instructions Retired
Supported? YES
Branch Mispredict Instructions Retired
Supported? YES

Misc
Processor Threads
Logical Processors per Package: 12
Cores per Physical Package: 6
Logical Processors per Core: 2
Monitor/MWait Leaf
Smallest Line Size (Bytes): 64
Largest Line Size (Bytes): 64
Interrupts Treated as Break-Event: Yes
Number of C0 Sub-States Supported: 0
Number of C1 Sub-States Supported: 2
Number of C2 Sub-States Supported: 1
Number of C3 Sub-States Supported: 1
Number of C4 Sub-States Supported: 0
Number of C5 Sub-States Supported: 0
Number of C6 Sub-States Supported: 0
Number of C7 Sub-States Supported: 0
Thermal & Power Management Leaf
Intel Turbo Boost Technology: Yes
APIC-Timer-Always-Running: Yes
Power Limit Notification Controls: No
Clock Modulation Duty Cycle Extension: No
Package Thermal Management: No
Hardware Performance States (HWP): No
HWP Notification: No
HWP Activity Window: No
HWP Energy Performance Preference: No
HWP Package Level Request: No
Hardware Duty Cycling: No
Intel Turbo Boost Max Technology 3.0: No
Number of Interrupt Thresholds: 2
ACNT/MCNT Support: Yes
Performance-Energy Bias Preference: No
Address Sizes
Physical Address (GB): 64
Logical Address (GB): 262144

I should also mention to you that I began the process of installingCUDA and cuDNN on my Win 10 machine according to your excellent directions on your website. I haven’t finished yet, but I did get an error message during the CUDA installation saying that my hardware may not be compatible, possibly because it may be too new. (As I mentioned, I just built it late last year.). So in case you are interested, I attached a DxDiag output file for that machine.

Let me know if there is anything else I can do.
And thanks again.
–Joel

Couldn’t attach the DxDiag.txt file for my Win machine. If you would like to see it, send me an email address I could use.


#7

Replied via email as you registered on peardox.com