title: Viral Pneumonia Screening on Chest X-ray Images Using Confidence-Aware Anomaly Detection

abstract: Cluster of viral pneumonia occurrences during a short period of time may be a harbinger of an outbreak or pandemic, like SARS, MERS, and recent COVID-19. Rapid and accurate detection of viral pneumonia using chest X-ray can be significantly useful in large-scale screening and epidemic prevention, particularly when other chest imaging modalities are less available. Viral pneumonia often have diverse causes and exhibit notably different visual appearances on X-ray images. The evolution of viruses and the emergence of novel mutated viruses further result in substantial dataset shift, which greatly limits the performance of classification approaches. In this paper, we formulate the task of differentiating viral pneumonia from non-viral pneumonia and healthy controls into an one-class classification-based anomaly detection problem, and thus propose the confidence-aware anomaly detection (CAAD) model, which consists of a shared feature extractor, an anomaly detection module, and a confidence prediction module. If the anomaly score produced by the anomaly detection module is large enough or the confidence score estimated by the confidence prediction module is small enough, we accept the input as an anomaly case (i.e., viral pneumonia). The major advantage of our approach over binary classification is that we avoid modeling individual viral pneumonia classes explicitly and treat all known viral pneumonia cases as anomalies to reinforce the one-class model. The proposed model outperforms binary classification models on the clinical X-VIRAL dataset that contains 5,977 viral pneumonia (no COVID-19) cases, 18,619 non-viral pneumonia cases, and 18,774 healthy controls.


title: Stochastic two-species mutualism model with jumps

abstract: The existence and uniqueness are proved for the global positive solution to the system of stochastic differential equations describing a two-species mutualism model disturbed by the white noise, the centered and non-centered Poisson noises. We obtain sufficient conditions for stochastic ultimate boundedness, stochastic permanence, nonpersistence in the mean, strong persistence in the mean and extinction of the solution to the considered system.


title: Dimension paradox of irrationally indifferent attractors

abstract: In this paper we study the geometry of the attractors of holomorphic maps with an irrationally indifferent fixed point. We prove that for an open set of such holomorphic systems, the local attractor at the fixed point has Hausdorff dimension two, provided the asymptotic rotation at the fixed point is of sufficiently high type and does not belong to Herman numbers. As an immediate corollary, the Hausdorff dimension of the Julia set of any such rational map with a Cremer fixed point is equal to two. Moreover, we show that for a class of asymptotic rotation numbers, the attractor satisfies Karpi\'{n}ska's dimension paradox. That is, the the set of end points of the attractor has dimension two, but without those end points, the dimension drops to one.


title: Assessing the Security of OPC UA Deployments

abstract: To address the increasing security demands of industrial deployments, OPC UA is one of the first industrial protocols explicitly designed with security in mind. However, deploying it securely requires a thorough configuration of a wide range of options. Thus, assessing the security of OPC UA deployments and their configuration is necessary to ensure secure operation, most importantly confidentiality and integrity of industrial processes. In this work, we present extensions to the popular Metasploit Framework to ease network-based security assessments of OPC UA deployments. To this end, we discuss methods to discover OPC UA servers, test their authentication, obtain their configuration, and check for vulnerabilities. Ultimately, our work enables operators to verify the (security) configuration of their systems and identify potential attack vectors.


title: Alternative probabilistic representations of Barenblatt-type solutions

abstract: A general class of probability density functions \[u(x,t)=Ct^{-\alpha d}\left (1-\left (\frac{\|x\|}{ct^{\alpha}}\right )^{\beta}\right )_+^{\gamma},\quad x\in \mathbb{R}^d,t>0,\] is considered, containing as particular case the Barenblatt solutions arising, for instance, in the study of nonlinear heat equations. Alternative probabilistic representations of the Barenblatt-type solutions $u(x,t)$ are proposed. In the one-dimensional case, by means of this approach, $u(x,t)$ can be connected with the wave propagation.


title: Solutions to indefinite weakly coupled cooperative elliptic systems

abstract: We study the elliptic system \begin{equation*} \begin{cases} -\Delta u_1 - \kappa_1u_1 = \mu_1|u_1|^{p-2}u_1 + \lambda\alpha|u_1|^{\alpha-2}|u_2|^\beta u_1, \\ -\Delta u_2 - \kappa_2u_2 = \mu_2|u_2|^{p-2}u_2 + \lambda\beta|u_1|^\alpha|u_2|^{\beta-2}u_2, \\ u_1,u_2\in D^{1,2}_0(\Omega), \end{cases} \end{equation*} where $\Omega$ is a bounded domain in $\mathbb{R}^N$, $N\geq 3$, $\kappa_1,\kappa_2\in\mathbb{R}$, $\mu_1,\mu_2,\lambda>0$, $\alpha,\beta>1$, and $\alpha + \beta = p\le 2^*:=\frac{2N}{N-2}$. For $p\in (2,2^*)$ we establish the existence of a ground state and of a prescribed number of fully nontrivial solutions to this system for $\lambda$ sufficiently large. If $p=2^*$ and $\kappa_1,\kappa_2>0$ we establish the existence of a ground state for $\lambda$ sufficiently large if, either $N\ge5$, or $N=4$ and neither $\kappa_1$ nor $\kappa_2$ are Dirichlet eigenvalues of $-\Delta$ in $\Omega$.


title: Introducing Pose Consistency and Warp-Alignment for Self-Supervised 6D Object Pose Estimation in Color Images

abstract: Most successful approaches to estimate the 6D pose of an object typically train a neural network by supervising the learning with annotated poses in real world images. These annotations are generally expensive to obtain and a common workaround is to generate and train on synthetic scenes, with the drawback of limited generalisation when the model is deployed in the real world. In this work, a two-stage 6D object pose estimator framework that can be applied on top of existing neural-network-based approaches and that does not require pose annotations on real images is proposed. The first self-supervised stage enforces the pose consistency between rendered predictions and real input images, narrowing the gap between the two domains. The second stage fine-tunes the previously trained model by enforcing the photometric consistency between pairs of different object views, where one image is warped and aligned to match the view of the other and thus enabling their comparison. In the absence of both real image annotations and depth information, applying the proposed framework on top of two recent approaches results in state-of-the-art performance when compared to methods trained only on synthetic data, domain adaptation baselines and a concurrent self-supervised approach on LINEMOD, LINEMOD OCCLUSION and HomebrewedDB datasets.


title: Covering minimal separators and potential maximal cliques in $P_t$-free graphs

abstract: A graph is called $P_t$-free} if it does not contain a $t$-vertex path as an induced subgraph. While $P_4$-free graphs are exactly cographs, the structure of $P_t$-free graphs for $t \geq 5$ remains little understood. On one hand, classic computational problems such as Maximum Weight Independent Set (MWIS) and $3$-Coloring are not known to be NP-hard on $P_t$-free graphs for any fixed $t$. On the other hand, despite significant effort, polynomial-time algorithms for MWIS in $P_6$-free graphs~[SODA 2019] and $3$-Coloring in $P_7$-free graphs~[Combinatorica 2018] have been found only recently. In both cases, the algorithms rely on deep structural insights into the considered graph classes. One of the main tools in the algorithms for MWIS in $P_5$-free graphs~[SODA 2014] and in $P_6$-free graphs~[SODA 2019] is the so-called Separator Covering Lemma that asserts that every minimal separator in the graph can be covered by the union of neighborhoods of a constant number of vertices. In this note we show that such a statement generalizes to $P_7$-free graphs and is false in $P_8$-free graphs. We also discuss analogues of such a statement for covering potential maximal cliques with unions of neighborhoods.


title: Convolutional Spiking Neural Networks for Spatio-Temporal Feature Extraction

abstract: Spiking neural networks (SNNs) can be used in low-power and embedded systems (such as emerging neuromorphic chips) due to their event-based nature. Also, they have the advantage of low computation cost in contrast to conventional artificial neural networks (ANNs), while preserving ANN's properties. However, temporal coding in layers of convolutional spiking neural networks and other types of SNNs has yet to be studied. In this paper, we provide insight into spatio-temporal feature extraction of convolutional SNNs in experiments designed to exploit this property. The shallow convolutional SNN outperforms state-of-the-art spatio-temporal feature extractor methods such as C3D, ConvLstm, and similar networks. Furthermore, we present a new deep spiking architecture to tackle real-world problems (in particular classification tasks) which achieved superior performance compared to other SNN methods on NMNIST (99.6%), DVS-CIFAR10 (69.2%) and DVS-Gesture (96.7%) and ANN methods on UCF-101 (42.1%) and HMDB-51 (21.5%) datasets. It is also worth noting that the training process is implemented based on variation of spatio-temporal backpropagation explained in the paper.


title: Mobile phone data and COVID-19: Missing an opportunity?

abstract: This paper describes how mobile phone data can guide government and public health authorities in determining the best course of action to control the COVID-19 pandemic and in assessing the effectiveness of control measures such as physical distancing. It identifies key gaps and reasons why this kind of data is only scarcely used, although their value in similar epidemics has proven in a number of use cases. It presents ways to overcome these gaps and key recommendations for urgent action, most notably the establishment of mixed expert groups on national and regional level, and the inclusion and support of governments and public authorities early on. It is authored by a group of experienced data scientists, epidemiologists, demographers and representatives of mobile network operators who jointly put their work at the service of the global effort to combat the COVID-19 pandemic.


title: Phonon dispersions throughout the iron spin crossover in ferropericlase

abstract: Ferropericlase (Fp), (Mg$_\mathrm{1-x}$Fe$_\mathrm{x}$)O, is the second most abundant phase in the Earths lower mantle. At relevant pressure-temperature conditions, iron in Fp undergoes a high spin (HS), S=2, to low spin (LS), S=0, state change. The nature of this phenomenon is quite well understood now, but there are still basic questions regarding the structural stability and the existence of soft phonon modes during this iron state change. General theories exist to explain the volume reduction, the significant thermo-elastic anomalies, and the broad nature of this HS-LS crossover. These theories make extensive use of the quasi-harmonic approximation (QHA). Therefore, dynamical and structural stability is essential to their validity. Here, we investigate the vibrational spectrum of Fp throughout this spin-crossover using $\textit{ab initio}$ DFT+Usc calculations. We address vibrational modes associated with isolated and (2nd) nearest neighbor iron ions undergoing the HS-LS state change. As expected, acoustic modes of this solid solution are resilient while optical modes are the most affected. We show that there are no soft phonon modes across this HS-LS crossover, and Fp is dynamically stable at all relevant pressures.


title: Splitting one ventilator for multiple patients -- a technical assessment

abstract: Due to the recent coronavirus outbreak, many efforts and innovative solutions have surfaced to deal with the possible shortage of ventilators upon catastrophic surges of patients. One solution involves splitting one ventilator to treat multiple patients and is in principle easy to implement, but there are obvious risks, and little is known on how the technique would work on patients with ARDS from Covid-19. Previous studies have shown that multiple test lungs of equal characteristics can be successfully ventilated from one machine, but that large variations in tidal volume delivery occurs when lungs with different compliance are connected. In contribution to the discussion of the feasibility of the technique, a technical assessment was done including experiments expanding on the previous studies using two types of test lungs, different ventilator settings and test lung characteristics. Using two test lungs connected to a ventilator, the tidal volumes and pressures into both lungs were measured for different combinations of lung compliance, airway resistances, modes of ventilation, inspiratory and end-expiratory pressure levels. We found discrepancies in delivered tidal volumes for paired test lungs proportional with compliance differences, little influence from differences in airway resistances, and that changes in compliance of only one test lung would also change the tidal volume delivered to the other test lung when in volume controlled mode. For one of the test lung types, we also found that higher PEEP settings could strongly influence the tidal volume balance between the test lungs. From this study and from a technical point of view, we were not able to identify reliable settings, adjustments or any simple measures to overcome the hazards of this simple technique, and a more advanced solution is indicated for mitigating risks.


title: Properties of Streamer Wave Events Observed During the STEREO Era

abstract: Transverse waves are sometimes observed in solar helmet streamers, typically after the passage of a coronal mass ejection (CME). The CME-driven shock wave moves the streamer sideways, and a decaying oscillation of the streamer is observed after the CME passage. Previous works generally reported observations of streamer oscillations taken from a single vantage point (typically the SOHO spacecraft). We conduct a data survey searching for streamer wave events observed by the COR2 coronagraphs onboard the STEREO spacecraft. For the first time, we report observations of streamer wave events from multiple vantage points, by using the COR2 instrument on both STEREO A and B, as well as the SOHO/LASCO C2+C3 coronagraphs. We investigate the properties of streamer waves by comparing the different events and performing a statistical analysis. Common observational features give us additional insight on the physical nature of streamer wave events. The most important conclusion is that there appears to be no relation between the speed of the CME and the phase speed of the resulting streamer wave, indicating that the streamer wave speed is determined by the physical properties of the streamer rather than the properties of the CME. This result makes streamer waves events excellent candidates for coronal seismology studies. From a comparison between the measured phase speeds and the phase speeds calculated from the measured periods and wavelengths, we could determine that the speed of the post-shock solar wind flow in our streamers is around 300 $\mathrm{km \ s}^{-1}$.


title: Observation of the in-plane magnetic field-induced phase transitions in FeSe

abstract: We investigate the thermodynamic properties of FeSe under the in-plane magnetic fields using torque magnetometry, specific heat, magnetocaloric measurements. Below the upper critical field Hc2, we observed the field-induced anomalies at H1 ~ 15 T and H2 ~ 22 T near H//ab and below a characteristic temperature T* ~ 2 K. The transition magnetic fields H1 and H2 exhibit negligible dependence on both temperature and field orientation. This contrasts with the strong temperature and angle dependence of Hc2, suggesting that these anomalies are attributed to the field-induced phase transitions, originating from the inherent spin-density-wave instability of quasiparticles near the superconducting gap minima or possible Flude-Ferrell-Larkin-Ovchinnikov state in the highly spin-polarized Fermi surfaces. Our observations imply that FeSe, an atypical multiband superconductor with extremely small Fermi energies, represents a unique model system for stabilizing unusual superconducting orders beyond the Pauli limit.


title: Enhanced Self-Perception in Mixed Reality: Egocentric Arm Segmentation and Database with Automatic Labelling

abstract: In this study, we focus on the egocentric segmentation of arms to improve self-perception in Augmented Virtuality (AV). The main contributions of this work are: i) a comprehensive survey of segmentation algorithms for AV; ii) an Egocentric Arm Segmentation Dataset, composed of more than 10, 000 images, comprising variations of skin color, and gender, among others. We provide all details required for the automated generation of groundtruth and semi-synthetic images; iii) the use of deep learning for the first time for segmenting arms in AV; iv) to showcase the usefulness of this database, we report results on different real egocentric hand datasets, including GTEA Gaze+, EDSH, EgoHands, Ego Youtube Hands, THU-Read, TEgO, FPAB, and Ego Gesture, which allow for direct comparisons with existing approaches utilizing color or depth. Results confirm the suitability of the EgoArm dataset for this task, achieving improvement up to 40% with respect to the original network, depending on the particular dataset. Results also suggest that, while approaches based on color or depth can work in controlled conditions (lack of occlusion, uniform lighting, only objects of interest in the near range, controlled background, etc.), egocentric segmentation based on deep learning is more robust in real AV applications.


title: Planning with Brain-inspired AI

abstract: This article surveys engineering and neuroscientific models of planning as a cognitive function, which is regarded as a typical function of fluid intelligence in the discussion of general intelligence. It aims to present existing planning models as references for realizing the planning function in brain-inspired AI or artificial general intelligence (AGI). It also proposes themes for the research and development of brain-inspired AI from the viewpoint of tasks and architecture.


title: A Hyperbolic Analogue of the Rademacher Symbol

abstract: One of the most famous results of Dedekind is the transformation law of $\log \Delta(z)$. After a half-century, Rademacher modified Dedekind's result and introduced an $\mathrm{SL}_2(\mathbb{Z})$-conjugacy class invariant (integer-valued) function $\Psi(\gamma)$ called the Rademacher symbol. Inspired by Ghys' work on modular knots, Duke-Imamo\={g}lu-T\'{o}th (2017) constructed a hyperbolic analogue of the symbol. In this article, we study their hyperbolic analogue of the Rademacher symbol $\Psi_\gamma(\sigma)$ and provide its two types of explicit formulas by comparing it with the classical Rademacher symbol. In association with it, we contrastively show Kronecker limit type formulas of the parabolic, elliptic, and hyperbolic Eisenstein series. These limits give harmonic, polar harmonic, and locally harmonic Maass forms of weight 2.


title: Slanted canonicity of analytic inductive inequalities

abstract: We prove an algebraic canonicity theorem for normal LE-logics of arbitrary signature, in a generalized setting in which the non-lattice connectives are interpreted as operations mapping tuples of elements of the given lattice to closed or open elements of its canonical extension. Interestingly, the syntactic shape of LE-inequalities which guarantees their canonicity in this generalized setting turns out to coincide with the syntactic shape of analytic inductive inequalities, which guarantees LE-inequalities to be equivalently captured by analytic structural rules of a proper display calculus. We show that this canonicity result connects and strengthens a number of recent canonicity results in two different areas: subordination algebras, and transfer results via G\"odel-McKinsey-Tarski translations.


title: Tuning an H-Infinity Controller with a Given Order and a Structure for Interconnected Systems with Delays

abstract: An eigenvalue based framework is developed for the H-infinity norm analysis and its norm minimization of coupled systems with time-delays, which are naturally described by delay differential algebraic equations (DDAEs). For these equations H-infinity norms are analyzed and their sensitivity with respect to small delay perturbations is studied. Subsequently, numerical methods for the H-infinity norm computation and for designing controllers minimizing the H-infinity norm with a prescribed structure or order, based on a direct optimization approach, are briefly addressed. The effectiveness of the approach is illustrated with a software demo. The chapter concludes by pointing out the similarities with the computation and optimization of characteristic roots of DDAEs.


title: Integral differential forms for superelliptic curves

abstract: Given a superelliptic curve $Y_K : y^n = f(x)$ over a local field $K$, we describe the theoretical background and an implementation of a new algorithm for computing the $\mathcal{O}_K$-lattice of integral differential forms on $Y_K$. We build on the results of Obus and the second author, which describe arbitrary regular models of the projective line using only valuations. One novelty of our approach is that we construct an $\mathcal{O}_K$-model of $Y_K$ with only rational singularities, but which may not be regular.


title: A PHY Layer Security Analysis of a Hybrid High Throughput Satellite with an Optical Feeder Link

abstract: Hybrid terrestrial-satellite (HTS) communication systems have gained a tremendous amount of interest recently due to the high demand for global high data rates. Conventional satellite communications operate in the conventional Ku (12 GHz) and Ka (26.5-40 GHz) radio-frequency bands for assessing the feeder link, between the ground gateway and the satellite. Nevertheless, with the aim to provide hundreds of Mbps of throughput per each user, free-space optical (FSO) feeder links have been proposed to fulfill these high data rates requirements. In this paper, we investigate the physical layer security performance for a hybrid very high throughput satellite communication system with an FSO feeder link. In particular, the satellite receives the incoming optical wave from an appropriate optical ground station, carrying the data symbols of $N$ users through various optical apertures and combines them using the selection combining technique. Henceforth, the decoded and regenerated information signals of the $N$ users are zero-forcing (ZF) precoded in order to cancel the interbeam interference at the end-users. The communication is performed under the presence of malicious eavesdroppers nodes at both hops. Statistical properties of the signal-to-noise ratio of the legitimate and wiretap links at each hop are derived, based on which the intercept probability metric is evaluated. The derived results show that above a certain number of optical apertures, the secrecy level is not improved further. Also, the system's secrecy is improved using ZF precoding compared to the no-precoding scenario for some specific nodes' positions. All the derived analytical expressions are validated through Monte Carlo simulations.


title: Guardauto: A Decentralized Runtime Protection System for Autonomous Driving

abstract: Due to the broad attack surface and the lack of runtime protection, potential safety and security threats hinder the real-life adoption of autonomous vehicles. Although efforts have been made to mitigate some specific attacks, there are few works on the protection of the self-driving system. This paper presents a decentralized self-protection framework called Guardauto to protect the self-driving system against runtime threats. First, Guardauto proposes an isolation model to decouple the self-driving system and isolate its components with a set of partitions. Second, Guardauto provides self-protection mechanisms for each target component, which combines different methods to monitor the target execution and plan adaption actions accordingly. Third, Guardauto provides cooperation among local self-protection mechanisms to identify the root-cause component in the case of cascading failures affecting multiple components. A prototype has been implemented and evaluated on the open-source autonomous driving system Autoware. Results show that Guardauto could effectively mitigate runtime failures and attacks, and protect the control system with acceptable performance overhead.


title: A metric space with transfinite asymptotic dimension $2\omega+1$

abstract: We construct a metric space whose transfinite asymptotic dimension and complementary-finite asymptotic dimension $2\omega+1$.


title: Character rings and fusion algebras

abstract: We present an overview of the close analogies between the character rings of finite groups and the fusion rings of rational conformal models, which follow from general principles related to orbifold deconstruction.


title: Can you hear me $\textit{now}$? Sensitive comparisons of human and machine perception

abstract: The rise of machine-learning systems that process sensory input has brought with it a rise in comparisons between human and machine perception. But such comparisons face a challenge: Whereas machine perception of some stimulus can often be probed through direct and explicit measures, much of human perceptual knowledge is latent, incomplete, or unavailable for explicit report. Here, we explore how this asymmetry can cause such comparisons to misestimate the overlap in human and machine perception. As a case study, we consider human perception of \textit{adversarial speech} -- synthetic audio commands that are recognized as valid messages by automated speech-recognition systems but that human listeners reportedly hear as meaningless noise. In five experiments, we adapt task designs from the human psychophysics literature to show that even when subjects cannot freely transcribe such speech commands (the previous benchmark for human understanding), they often can demonstrate other forms of understanding, including discriminating adversarial speech from closely matched non-speech (Experiments 1--2), finishing common phrases begun in adversarial speech (Experiments 3--4), and solving simple math problems posed in adversarial speech (Experiment 5) -- even for stimuli previously described as unintelligible to human listeners. We recommend the adoption of such "sensitive tests" when comparing human and machine perception, and we discuss the broader consequences of such approaches for assessing the overlap between systems.


title: Modeling and Assessment of IoT Supply Chain Security Risks: The Role of Structural and Parametric Uncertainties

abstract: Supply chain security threats pose new challenges to security risk modeling techniques for complex ICT systems such as the IoT. With established techniques drawn from attack trees and reliability analysis providing needed points of reference, graph-based analysis can provide a framework for considering the role of suppliers in such systems. We present such a framework here while highlighting the need for a component-centered model. Given resource limitations when applying this model to existing systems, we study various classes of uncertainties in model development, including structural uncertainties and uncertainties in the magnitude of estimated event probabilities. Using case studies, we find that structural uncertainties constitute a greater challenge to model utility and as such should receive particular attention. Best practices in the face of these uncertainties are proposed.


title: Bump Functions With Monotone Fourier Transforms Satisfying Decay Bounds

abstract: The existence of a smooth, nonnegative, compactly supported function with monotone (on the half-line) Fourier transform satisfying two-sided decay bounds is demonstrated.


title: Can We Use Split Learning on 1D CNN Models for Privacy Preserving Training?

abstract: A new collaborative learning, called split learning, was recently introduced, aiming to protect user data privacy without revealing raw input data to a server. It collaboratively runs a deep neural network model where the model is split into two parts, one for the client and the other for the server. Therefore, the server has no direct access to raw data processed at the client. Until now, the split learning is believed to be a promising approach to protect the client's raw data; for example, the client's data was protected in healthcare image applications using 2D convolutional neural network (CNN) models. However, it is still unclear whether the split learning can be applied to other deep learning models, in particular, 1D CNN. In this paper, we examine whether split learning can be used to perform privacy-preserving training for 1D CNN models. To answer this, we first design and implement an 1D CNN model under split learning and validate its efficacy in detecting heart abnormalities using medical ECG data. We observed that the 1D CNN model under split learning can achieve the same accuracy of 98.9\% like the original (non-split) model. However, our evaluation demonstrates that split learning may fail to protect the raw data privacy on 1D CNN models. To address the observed privacy leakage in split learning, we adopt two privacy leakage mitigation techniques: 1) adding more hidden layers to the client side and 2) applying differential privacy. Although those mitigation techniques are helpful in reducing privacy leakage, they have a significant impact on model accuracy. Hence, based on those results, we conclude that split learning alone would not be sufficient to maintain the confidentiality of raw sequential data in 1D CNN models.


title: Training for Speech Recognition on Coprocessors

abstract: Automatic Speech Recognition (ASR) has increased in popularity in recent years. The evolution of processor and storage technologies has enabled more advanced ASR mechanisms, fueling the development of virtual assistants such as Amazon Alexa, Apple Siri, Microsoft Cortana, and Google Home. The interest in such assistants, in turn, has amplified the novel developments in ASR research. However, despite this popularity, there has not been a detailed training efficiency analysis of modern ASR systems. This mainly stems from: the proprietary nature of many modern applications that depend on ASR, like the ones listed above; the relatively expensive co-processor hardware that is used to accelerate ASR by big vendors to enable such applications; and the absence of well-established benchmarks. The goal of this paper is to address the latter two of these challenges. The paper first describes an ASR model, based on a deep neural network inspired by recent work in this domain, and our experiences building it. Then we evaluate this model on three CPU-GPU co-processor platforms that represent different budget categories. Our results demonstrate that utilizing hardware acceleration yields good results even without high-end equipment. While the most expensive platform (10X price of the least expensive one) converges to the initial accuracy target 10-30% and 60-70% faster than the other two, the differences among the platforms almost disappear at slightly higher accuracy targets. In addition, our results further highlight both the difficulty of evaluating ASR systems due to the complex, long, and resource intensive nature of the model training in this domain, and the importance of establishing benchmarks for ASR.


title: Thermal Casimir effect with general boundary conditions

abstract: In this paper we study the system of a scalar quantum field confined between two plane, isotropic, and homogeneous parallel plates at thermal equilibrium. We represent the plates by the most general lossless and frequency-independent boundary conditions that satisfy the conditions of isotropy and homogeneity and are compatible with the unitarity of the quantum field theory. Under these conditions we compute the thermal correction to the quantum vacuum energy as a function of the temperature and the parameters encoding the boundary condition. The latter enables us to obtain similar results for the pressure between plates and the quantum thermal correction to the entropy. We find out that our system is thermodynamically stable for any boundary conditions, and we identify a critical temperature below which certain boundary conditions yield attractive, repulsive, and null Casimir forces.


title: Optical spectroscopic observations of gamma-ray blazar candidates. IX. Optical archival spectra and further observations from SOAR and OAGH

abstract: Nearly one-third of the sources in the $Fermi$-LAT catalogs lack a lower energy counterpart, hence being referred as unidentified/unassociated gamma-ray sources (UGSs). In order to firmly classify them, dedicated multifrequency follow-up campaigns are necessary. These will permit to unveil their nature and identify the fraction that could belong to the class of active galaxies known as blazars that is the largest population of extragalactic $\gamma$-ray sources. In $Fermi$-LAT catalogs there are also gamma-ray sources associated with multifrequency blazar-like objects known as Blazars Candidates of Uncertain type (i.e., BCUs) for which follow up spectroscopic campaigns are mandatory to confirm their blazar nature. Thus, in 2013 we started an optical spectroscopic campaign to identify blazar-like objects potential counterparts of UGSs and BCUs. Here we report the spectra of 31 additional targets observed as part of our follow up campaign. Thirteen of them are BCUs for which we acquired spectroscopic observations at Observatorio Astrof\'isico Guillermo Haro (OAGH) and at Southern Astrophysical Research Observatory (SOAR) telescopes, while the rest has been identified thanks to the archival observations available from the Sloan Digital Sky Survey (SDSS). We confirm the blazar nature of all BCUs: three of them are in blazar of quasar type (BZQs) while the remaining ones can be spectroscopically classified as BL Lac objects (BZBs). Then we also discovered 18 BL Lac objects lying within the positional uncertainty regions of UGSs that could be their potential counterparts.


title: Solving Quasistatic Contact Problems Using Nonsmooth Optimization Approach

abstract: This paper is devoted to a study of time-dependent hemivariational inequality. We prove existence and uniqueness of its solution, provide fully discrete scheme and reformulate this scheme as a series of nonsmooth optimization problems. This theory is later applied to a sample quasistatic contact problem describing a viscoelastic body in frictional contact with a foundation. This contact is governed by a nonmonotone friction law with dependence on normal component of displacement and tangential component of velocity. Finally, computational simulations are performed to illustrate obtained results.


title: Coefficients problems for families of holomorphic functions related to hyperbola

abstract: We consider a family of analytic and normalized functions that are related to the domains $\mathbb{H}(s)$, with a right branch of a hyperbolas $H(s)$ as a boundary. The hyperbola $H(s)$ is given by the relation $\frac{1}{\rho}=\left( 2\cos\frac{\varphi}{s}\right)^s\quad (0<s\le 1,\ |\varphi|<(\pi s)/2$). We mainly study a coefficient problem of the families of functions for which $zf'/f$ or $1+zf''/f'$ map the unit disk onto a subset of $\mathbb{H}(s)$. We find coefficients bounds, solve Fekete-Szeg\"{o} problem and estimate the Hankel determinant.


title: Microscopic derivation of the Fr\"ohlich Hamiltonian for the Bose polaron in the mean-field limit

abstract: We consider the quantum mechanical many-body problem of a single impurity particle immersed in a weakly interacting Bose gas. The impurity interacts with the bosons via a two-body potential. We study the Hamiltonian of this system in the mean-field limit and rigorously show that, at low energies, the problem is well described by the Fr\"ohlich polaron model.


title: Surface operators in the 6d $\mathcal{N} = (2,0)$ theory

abstract: The 6d $\mathcal{N}=(2,0)$ theory has natural surface operator observables, which are akin in many ways to Wilson loops in gauge theories. We propose a definition of a "locally BPS" surface operator and study its conformal anomalies, the analog of the conformal dimension of local operators. We study the abelian theory and the holographic dual of the large $N$ theory refining previously used techniques. Introducing non-constant couplings to the scalar fields allows for an extra anomaly coefficient, which we find in both cases to be related to one of the geometrical anomaly coefficients, suggesting a general relation due to supersymmetry. We also comment on surfaces with conical singularities.


title: Discontinuous Galerkin method for incompressible two-phase flows

abstract: In this contribution we present a local discontinuous Galerkin (LDG) pressure-correction scheme for the incompressible Navier-Stokes equations. The scheme does not need penalty parameters and satisfies the discrete continuity equation exactly. The scheme is especially suitable for two-phase flow when used with a piecewise-linear interface construction (PLIC) volume-of-fluid (VoF) method and cut-cell quadratures.


title: Three-body vs. dineutron approach to two-neutron radiative capture in $^{6}$He

abstract: The low-energy behavior of the strength function for the $1^-$ soft dipole excitation in $^{6}$He is studied theoretically. Use of very large basis sizes and well-grounded extrapolation procedures allows to move to energies as small as 1 keV, at which the low-energy asymptotic behavior of the E1 strength function seems to be achieved. It is found that the low-energy behavior of the strength function is well described in the effective three-body "dynamical dineutron model". The astrophysical rate for the $\alpha$+$n$+$n \rightarrow ^6$He+$\gamma$ is calculated. Comparison with the previous calculations is performed.


title: Democratic Value and Money for Decentralized Digital Society

abstract: Classical monetary systems regularly subject the most vulnerable majority of the world's population to debilitating financial shocks, and have manifestly allowed uncontrolled global inequality over the long term. Given these basic failures, how can we avoid asking whether mainstream macroeconomic principles are actually compatible with democratic principles such as equality or the protection of human rights and dignity? This idea paper takes a constructive look at this question, by exploring how alternate monetary principles might result in a form of money more compatible with democratic principles -- dare we call it "democratic money"? In this alternative macroeconomic philosophy, both the supply of and the demand for money must be rooted in people, so as to give all people both equal opportunities for economic participation. Money must be designed around equality, not only across all people alive at a given moment, but also across past and future generations of people, guaranteeing that our descendants cannot be enslaved by their ancestors' economic luck or misfortune. Democratic money must reliably give all people a means to enable everyday commerce, investment, and value creation in good times and bad, and must impose hard limits on financial inequality. Democratic money must itself be governed democratically, and must economically facilitate the needs of citizens in a democracy for trustworthy and unbiased information with which to make wise collective decisions. An intriguing approach to implementing and deploying democratic money is via a cryptocurrency built on a proof-of-personhood foundation, giving each opt-in human participant one equal unit of stake. Such a cryptocurrency would have both interesting similarities to, and important differences from, a Universal Basic Income (UBI) denominated in an existing currency.


title: Cosmic muon flux measurement and tunnel overburden structure imaging

abstract: We present a cosmic ray muon tomographic experiment for measuring the muon flux and imaging the tunnel overburden structures in Changshu, China. The device used in this study is a tracking detector based on the plastic scintillator with SiPM technology, which can be conveniently operated in field works. The compact system with sensitive area of $6400 cm^2$ can measure the angular distribution of cosmic muons. It's able to image the overburden density length from the surface of overburden to the detector along the muon tracks. The open sky muon flux measurement outside the tunnel has a good agreement with the modified Gassier Formula model. The distributions of muon flux at three positions inside the tunnel are very similar to that of open sky. Assuming the average density of overburden compact sandstone is $2.65 g/cm^3$, the overburden thickness can be obtained from the density length derived from the difference of muon flux inside and outside the tunnel. Moreover, for known penetrated lengths (i.e., topography of overburden), the density anomalies of the overburden can also been obtained. This study suggests a potential application for imaging and detecting subsurface structures in civil engineering, tunnels or caverns with the cosmic ray muon telescope.


title: Some log and weak majorization inequalities in Euclidean Jordan algebras

abstract: Motivated by Horn's log-majorization (singular value) inequality $s(AB)\underset{log}{\prec} s(A)*s(B)$ and the related weak-majorization inequality $s(AB)\underset{w}{\prec} s(A)*s(B)$ for square complex matrices, we consider their Hermitian analogs $\lambda(\sqrt{A}B\sqrt{A}) \underset{log}{\prec} \lambda(A)*\lambda(B)$ for positive semidefinite matrices and $\lambda(|A\circ B|) \underset{w}{\prec} \lambda(|A|)*\lambda(|B|)$ for general (Hermitian) matrices, where $A\circ B$ denotes the Jordan product of $A$ and $B$ and $*$ denotes the componentwise product in $R^n$. In this paper, we extended these inequalities to the setting of Euclidean Jordan algebras in the form $\lambda\big (P_{\sqrt{a}}(b)\big )\underset{log}{\prec} \lambda(a)*\lambda(b)$ for $a,b\geq 0$ and $\lambda\big (|a\circ b|\big )\underset{w}{\prec} \lambda(|a|)*\lambda(|b|)$ for all $a$ and $b$, where $P_u$ and $\lambda(u)$ denote, respectively, the quadratic representation and the eigenvalue vector of an element $u$. We also describe inequalities of the form $\lambda(|A\bullet b|)\underset{w}{\prec} \lambda({\mathrm{diag}}(A))*\lambda(|b|)$, where $A$ is a real symmetric positive semidefinite matrix and $A\,\bullet\, b$ is the Schur product of $A$ and $b$. In the form of an application, we prove the generalized H\"{o}lder type inequality $||a\circ b||_p\leq ||a||_r\,||b||_s$, where $||x||_p:=||\lambda(x)||_p$ denotes the spectral $p$-norm of $x$ and $p,q,r\in [1,\infty]$ with $\frac{1}{p}=\frac{1}{r}+\frac{1}{s}$. We also give precise values of the norms of the Lyapunov transformation $L_a$ and $P_a$ relative to two spectral $p$-norms.


title: Symmetrized poly-Bernoulli numbers and combinatorics

abstract: Poly-Bernoulli numbers are one of generalizations of the classical Bernoulli numbers. Since a negative index poly-Bernoulli number is an integer, it is an interesting problem to study this number from combinatorial viewpoint. In this short article, we give a new combinatorial relation between symmetrized poly-Bernoulli numbers and the Dumont-Foata polynomials.


abstract: We characterize unmixed and Cohen-Macaulay edge-weighted edge ideals of very well-covered graphs. We also provide examples of oriented graphs which have unmixed and non-Cohen-Macaulay vertex-weighted edge ideals, while the edge ideal of their underlying graph is Cohen-Macaulay. This disproves a conjecture posed by Pitones, Reyes and Toledo.


title: General formula to design a freeform singlet free of spherical aberration and astigmatism : Comment

abstract: In their article -Appl. Opt. 58, 1010_1015 (2019)- Gonz\'alez-Acu\~na et al claimed:"an analytical closed-form formula for the design of freeform lenses free of spherical aberration and astigmatism." However, as we show here, their formula can only be applied when the object and image are both real and the image is inversed, additionally, the refractive index in the object and image media is the same. Here, we present the complete solution of this particular formula.


title: Unsupervised Fuzzy eIX: Evolving Internal-eXternal Fuzzy Clustering

abstract: Time-varying classifiers, namely, evolving classifiers, play an important role in a scenario in which information is available as a never-ending online data stream. We present a new unsupervised learning method for numerical data called evolving Internal-eXternal Fuzzy clustering method (Fuzzy eIX). We develop the notion of double-boundary fuzzy granules and elaborate on its implications. Type 1 and type 2 fuzzy inference systems can be obtained from the projection of Fuzzy eIX granules. We perform the principle of the balanced information granularity within Fuzzy eIX classifiers to achieve a higher level of model understandability. Internal and external granules are updated from a numerical data stream at the same time that the global granular structure of the classifier is autonomously evolved. A synthetic nonstationary problem called Rotation of Twin Gaussians shows the behavior of the classifier. The Fuzzy eIX classifier could keep up with its accuracy in a scenario in which offline-trained classifiers would clearly have their accuracy drastically dropped.


title: PyMatting: A Python Library for Alpha Matting

abstract: An important step of many image editing tasks is to extract specific objects from an image in order to place them in a scene of a movie or compose them onto another background. Alpha matting describes the problem of separating the objects in the foreground from the background of an image given only a rough sketch. We introduce the PyMatting package for Python which implements various approaches to solve the alpha matting problem. Our toolbox is also able to extract the foreground of an image given the alpha matte. The implementation aims to be computationally efficient and easy to use. The source code of PyMatting is available under an open-source license at https://github.com/pymatting/pymatting.


title: End-to-End Entity Classification on Multimodal Knowledge Graphs

abstract: End-to-end multimodal learning on knowledge graphs has been left largely unaddressed. Instead, most end-to-end models such as message passing networks learn solely from the relational information encoded in graphs' structure: raw values, or literals, are either omitted completely or are stripped from their values and treated as regular nodes. In either case we lose potentially relevant information which could have otherwise been exploited by our learning methods. To avoid this, we must treat literals and non-literals as separate cases. We must also address each modality separately and accordingly: numbers, texts, images, geometries, et cetera. We propose a multimodal message passing network which not only learns end-to-end from the structure of graphs, but also from their possibly divers set of multimodal node features. Our model uses dedicated (neural) encoders to naturally learn embeddings for node features belonging to five different types of modalities, including images and geometries, which are projected into a joint representation space together with their relational information. We demonstrate our model on a node classification task, and evaluate the effect that each modality has on the overall performance. Our result supports our hypothesis that including information from multiple modalities can help our models obtain a better overall performance.


title: Extremality of graph entropy based on Laplacian degrees of k-uniform hypergraphs

abstract: The graph entropy describes the structural information of graph. Motivated by the definition of graph entropy in general graphs, the graph entropy of hypergraphs based on Laplacian degree are defined. Some results on graph entropy of simple graphs are extended to k-uniform hypergraphs. Using an edge-moving operation, the maximum and minimum graph entropy based on Laplacian degrees are determined in k-uniform hypertrees, unicyclic k-uniform hypergraphs, bicyclic k-uniform hypergraphs and k-uniform chemical hypertrees, respectively, and the corresponding extremal graphs are determined.


title: A Tutorial on the Basic Special Functions of Fractional Calculus

abstract: In this tutorial survey we recall the basic properties of the special function of the Mittag-Leffler and Wright type that are known to be relevant in processes dealt with the fractional calculus. We outline the major applications of these functions. For the Mittag-Leffler functions we analyze the Abel integral equation of the second kind and the fractional relaxation and oscillation phenomena. For the Wright functions we distinguish them in two kinds. We mainly stress the relevance of the Wright functions of the second kind in probability theory with particular regard to the so-called M-Wright function that generalizes the Gaussian and is related with the time-fractional diffusion equation.


title: A New Gene Selection Algorithm using Fuzzy-Rough Set Theory for Tumor Classification

abstract: In statistics and machine learning, feature selection is the process of picking a subset of relevant attributes for utilizing in a predictive model. Recently, rough set-based feature selection techniques, that employ feature dependency to perform selection process, have been drawn attention. Classification of tumors based on gene expression is utilized to diagnose proper treatment and prognosis of the disease in bioinformatics applications. Microarray gene expression data includes superfluous feature genes of high dimensionality and smaller training instances. Since exact supervised classification of gene expression instances in such high-dimensional problems is very complex, the selection of appropriate genes is a crucial task for tumor classification. In this study, we present a new technique for gene selection using a discernibility matrix of fuzzy-rough sets. The proposed technique takes into account the similarity of those instances that have the same and different class labels to improve the gene selection results, while the state-of-the art previous approaches only address the similarity of instances with different class labels. To meet that requirement, we extend the Johnson reducer technique into the fuzzy case. Experimental results demonstrate that this technique provides better efficiency compared to the state-of-the-art approaches.


title: Spectral characteristics of the antiferromagnetic spin-1/2 Heisenberg model on the square lattice in a magnetic field

abstract: We predict that spin-waves in an ordered square quantum antiferromagnet in a transverse magnetic field (h) may demonstrate three modes of spin excitations. Starting from the self-consistent rotation-invariant Green's function method, a new mean-field theory is constructed for h not equal to 0. The method preserves the translational and the axial symmetries, and provides exact fulfillment of the single-site constraint for each of the three modes. We examine the dynamical structure factors S(aa)(k,w), a= x, y, z. It is shown, that the introduction of h leads to the hybridization of two degenerate spin modes due to the appearance of a nondiagonal on a, b spin-spin Green's functions. The comparison of the theory with the exact diagonalization study and with results on inelastic neutron scattering experiments is discussed at T = 0. We discuss also the correspondence of the theory to the existing theories, which allow only two spin excitations modes for the total S(k,w).


title: Molecule Identification with Rotational Spectroscopy and Probabilistic Deep Learning

abstract: A proof-of-concept framework for identifying molecules of unknown elemental composition and structure using experimental rotational data and probabilistic deep learning is presented. Using a minimal set of input data determined experimentally, we describe four neural network architectures that yield information to assist in the identification of an unknown molecule. The first architecture translates spectroscopic parameters into Coulomb matrix eigenspectra, as a method of recovering chemical and structural information encoded in the rotational spectrum. The eigenspectrum is subsequently used by three deep learning networks to constrain the range of stoichiometries, generate SMILES strings, and predict the most likely functional groups present in the molecule. In each model, we utilize dropout layers as an approximation to Bayesian sampling, which subsequently generates probabilistic predictions from otherwise deterministic models. These models are trained on a modestly sized theoretical dataset comprising ${\sim}$83,000 unique organic molecules (between 18 and 180 amu) optimized at the $\omega$B97X-D/6-31+G(d) level of theory where the theoretical uncertainty of the spectroscopic constants are well understood and used to further augment training. Since chemical and structural properties depend highly on molecular composition, we divided the dataset into four groups corresponding to pure hydrocarbons, oxygen-bearing, nitrogen-bearing, and both oxygen- and nitrogen-bearing species, training each type of network with one of these categories thus creating "experts" within each domain of molecules. We demonstrate how these models can then be used for practical inference on four molecules, and discuss both the strengths and shortcomings of our approach, and the future directions these architectures can take.


title: Properties of Short GRB Pulses in the Fourth BATSE Catalog: Implications for Structure and Evolution of the Jetted Outflows

abstract: Considering the shortage of comparative studies on pulse temporal characteristics between single-peaked short gamma-ray bursts (sGRBs) and double-peaked sGRBs, we examine the pulse properties of a sample of 100 BATSE sGRBs using the BATSE Time-Tagged Event (TTE) data with a 5-ms resolution. 243 individual pulses of the single-peaked, double-peaked and triple-peaked sGRBs are fitted to get their statistical properties such as the pulse asymmetry, amplitude, peak time, and pulse width, etc. For the double-peaked sGRBs, according to the overlapping ratio between two adjacent peaks, we first define two kinds of double-peaked sGRBs as M-loose and M-tight types and find that most of the first pulses are similar to the single-peaked ones. We study the dependence of the Full Width at Half Maximum (FWHM) on the photon energy among different energy bands. Interestingly, it is found that a power-law relation with an index of -0.4 does exist between the FWHM and the photon energy for the single- and double-peaked sGRBs. More interestingly, we notice that the power-law relation with a positive index also exist for several special short bursts. In view of the three typical timescales of pulses, namely the angular spreading timescale, the dynamic timescale, and the cooling timescale, we propose that the diverse power-law indexes together with the profile evolution of GRB pulse can be used as an effective probe to diagnose the structure and evolution of the relativistically jetted outflows.


title: Deriving a representative variant for the functional safety development according to ISO 26262

abstract: The emerging mass individualization in series produced road vehicles, superseding mass customization, entails an increase in variants. The question "How may the functional safety development effort, corresponding to the variant numbers, be tackled while complying to the standard ISO 26262:2018?" motives this work. The lever on containing the effort is most effective when applied in the development life-cycle as early as possible. The initiating functional safety artifact is the item definition. Strategic clustering of variants into a few or even a single item-definition(s) is feasible by exploiting platform development. Yet, the functional safety development effort for each defined item may only be limited when basing all subsequent phases on one single representative variant. In this work we particularly elaborate on answering the question "Under what conditions can a representative variant be defined?", accompanied by the notion of "How is it defined?". Therefore, we assess the ISO 26262:2018 for deriving prerequisites on a representative variant. Furthermore, we propose a structured and efficient method to determine representative variants given vehicle parameters and a framing context. The method is exemplified for two easily comprehensible use-case situations in drivetrain development. The characteristic equations may be used for future drivetrain functional safety development.


title: What pp SUSY limits mean for future e$^+$e$^-$ colliders

abstract: It is well-known that e$^+$e$^-$ colliders have the power to with certainty exclude or discover any SUSY model that predicts a Next to lightest SUSY particle (an NLSP) that has a mass up to slightly below the half the centre-of-mass energy of the collider. Here, we present an estimation of the power of present and future hadron colliders to extend the reach of searches for SUSY, with particular emphasis whether it can be claimed that either discovery or exclusion is {\it guaranteed} in a region of LSP and NLSP masses - no set of values of the other SUSY could change the conclusion. A scan over SUSY parameter space was done, only requiring that the NLSP was a bosino - the hardest case - with mass not larger than a few TeV. The mass-spectrum, cross-sections and decay branching ratios found in this region were confronted with projections of sensitivity at future hadron colliders. In our conclusions we weigh in the maturity of the analysis the projections are based upon. The conclusion is that although future hadron colliders have a large discovery-reach, i.e. potential to discover {\it some} SUSY model, hardly any models with low-to-medium LSP-NLSP mass-differences can be excluded with certainty. The models that are expected to be excluded/discovered are, on one hand, those with mass-differences larger than those allowed by models with GUT-scale $M_1$-$M_2$ unification, and on the other hand, a tiny region where the mass-difference is so small that the NLSP decays in the tracking volume of the detectors. Excluding the latter possibility does not, however, allow to exclude the possibility of a Wino or Higgsino LSP: at any value of the LSP mass, we could identify models where the NLSP lifetime would be too short for a signal to be seen.


title: Structural properties and average tapping time on scale-free graphs with smallest diameter

abstract: In this paper, we propose a class of graphs $G^{\star}(m,t)$ and first study some structural properties, such as, average degree, on them. The results show that (1) graphs $G^{\star}(m,t)$ have density feature because of their average degrees proportional to time step $t$ not to a constant in the large graph size limit, (2) graphs $G^{\star}(m,t)$ obey the power-law distribution with exponent equal to $2$, which is rarely found in most previous scale-free models, (3) graphs $G^{\star}(m,t)$ display small-world property in terms of ultra-small diameter and higher clustering coefficient, and (4) graphs $G^{\star}(m,t)$ possess disassortative structure with respect to Pearson correlation coefficient smaller than zero. In addition, we consider the trapping problem on the proposed graphs $G^{\star}(m,t)$ and then find that they all have more optimal trapping efficiency by means of their own average trapping time achieving the theoretical lower bound, a phenomenon that is seldom observed in existing scale-free models. We conduct extensive simulations that are consistent with our theoretical analysis.


title: A Liquid Perspective on Democratic Choice

abstract: The idea of liquid democracy responds to a widely-felt desire to make democracy more "fluid" and continuously participatory. Its central premise is to enable users to employ networked technologies to control and delegate voting power, to approximate the ideal of direct democracy in a scalable fashion that accounts for time and attention limits. There are many potential definitions, meanings, and ways to implement liquid democracy, however, and many distinct purposes to which it might be deployed. This paper develops and explores the "liquid" notion and what it might mean for purposes of enhancing voter choice by spreading voting power, improving proportional representation systems, simplifying or aiding voters in their choice, or scaling direct democracy through specialization. The goal of this paper is to disentangle and further develop some of the many concepts and goals that liquid democracy ideas often embody, to explore their justification with respect to existing democratic traditions such as transferable voting and political parties, and to explore potential risks in liquid democracy systems and ways to address them.


title: Subcritical behaviour in double diffusive convection within the diffusive regime

abstract: We conduct two- and three-dimensional simulations for double diffusive convection in the diffusive regime, where the fluid flow is driven by a destabilizing temperature gradient and stabilized by a stably stratified salinity gradient. We study how the heat flux, Reynolds number, and flow structures change with the density ratio $\Lambda$, which is the ratio of the buoyancy force induced by the salinity gradient to that by the temperature gradient. When $\Lambda$ increases from zero, the flow first behaves similarly as in pure Rayleigh-B\'enard (RB) convection, both with respect to flow structure and to heat transport. The linear stability analysis of Baines & Gill (J. Fluid Mech., vol. 37, 1969, pp. 289-306) had estimated the critical density ratio $\Lambda_c$, above which the flow becomes stable. However, here we show that by using a large-scale circulation as initial condition (rather than the linear profiles assumed in the linear stability analysis), DDC in the diffusive regime can exhibit subcritical behaviour when $\Lambda > \Lambda_c$, i.e., coexistence of states at the same control parameters. Even though the density ratio becomes thousands times that of the critical value $\Lambda_c$, there is still convection with strongly enhanced heat transfer properties compared to the pure conduction case. We reveal the corresponding flow structures and find an unstably-stratified region sandwiched between two stably-stratified layers. Our results demonstrate the importance of the initial condition for DDC in the diffusive regime, especially in the situation of a large density ratio, which occurs in high-latitude ocean regions.


title: Meissner Currents Induced by Topological Magnetic Textures in Hybrid Superconductor/Ferromagnet Structures

abstract: Topological spin configurations in proximity to a superconductor have recently attracted great interest due to the potential application of the former in spintronics and also as another platform for realizing non-trivial topological superconductors. Their application in these areas requires precise knowledge of the existing exchange fields and/or the stray-fields which are therefore essential for the study of these systems. Here, we determine the effective stray-field and the Meissner currents in a Superconductor/Ferromagnet/Superconductor (S/F/S) junction produced by various nonhomogenous magnetic textures in the F. The inhomogeneity arises either due to a periodic structure with flat domain walls (DW) or is caused by an isolated chiral magnetic skyrmion (Sk). We consider both Bloch- and N\'{e}el-type Sk and also analyze in detail the periodic structures of different types of DW's-- that is Bloch-type DW (BDW) and N\'{e}el-type DW (NDW) of finite width with in- and out-of-plane magnetization vector. The spatial dependence of the fields and Meissner currents are shown to be qualitatively different for the case of Bloch- and N\'{e}el-type magnetic textures. While the spatial distributions in the upper and lower S are identical for Bloch-type Sk and DW's they are asymmetric for the case of N\'{e}el-type magnetic textures. The depairing factor, which determines the critical temperature and which is related to vector potential of the stray-field, can have its maximum at the center of a magnetic domain but also, as we show, above the DW. For Sk's the maximum is located at a finite distance within the Sk radius. Based on this, we study the nucleation of superconductivity in the presence of DW's. Because of the asymmetry for N\'{e}el-type structures, the critical temperature in the upper and lower S is expected to be different. The obtained results can also be applied to S/F bilayers.


title: Time Series Data Cleaning: From Anomaly Detection to Anomaly Repairing (Technical Report)

abstract: Errors are prevalent in time series data, such as GPS trajectories or sensor readings. Existing methods focus more on anomaly detection but not on repairing the detected anomalies. By simply filtering out the dirty data via anomaly detection, applications could still be unreliable over the incomplete time series. Instead of simply discarding anomalies, we propose to (iteratively) repair them in time series data, by creatively bonding the beauty of temporal nature in anomaly detection with the widely considered minimum change principle in data repairing. Our major contributions include: (1) a novel framework of iterative minimum repairing (IMR) over time series data, (2) explicit analysis on convergence of the proposed iterative minimum repairing, and (3) efficient estimation of parameters in each iteration. Remarkably, with incremental computation, we reduce the complexity of parameter estimation from O(n) to O(1). Experiments on real datasets demonstrate the superiority of our proposal compared to the state-of-the-art approaches. In particular, we show that (the proposed) repairing indeed improves the time series classification application.


title: Modeling 3D Shapes by Reinforcement Learning

abstract: We explore how to enable machines to model 3D shapes like human modelers using deep reinforcement learning (RL). In 3D modeling software like Maya, a modeler usually creates a mesh model in two steps: (1) approximating the shape using a set of primitives; (2) editing the meshes of the primitives to create detailed geometry. Inspired by such artist-based modeling, we propose a two-step neural framework based on RL to learn 3D modeling policies. By taking actions and collecting rewards in an interactive environment, the agents first learn to parse a target shape into primitives and then to edit the geometry. To effectively train the modeling agents, we introduce a novel training algorithm that combines heuristic policy, imitation learning and reinforcement learning. Our experiments show that the agents can learn good policies to produce regular and structure-aware mesh models, which demonstrates the feasibility and effectiveness of the proposed RL framework.


title: Destruction of superconductivity through phase fluctuations in ultrathin a-MoGe films

abstract: We investigate the evolution of superconductivity with decreasing film thickness in ultrathin amorphous MoGe (a-MoGe) films using a combination of sub-Kelvin scanning tunneling spectroscopy, magnetic penetration depth measurements and magneto-transport measurements. We observe that superconductivity is strongly affected by quantum and classical phase fluctuations for thickness below 5 nm. The superfluid density is strongly suppressed by quantum phase fluctuations at low temperatures and evolves towards a linear-T dependence at higher temperatures. This is associated with a rapid decrease in the superconducting transition temperature, Tc, and the emergence of a pronounced pseudogap above Tc. These observations suggest that at strong disorder the destruction of superconductivity follows a Bosonic route where the global superconducting state is destroyed by phase fluctuations even though the pairing amplitude remains finite.


title: Imaging the emergence of bacterial turbulence: phase diagram and transition kinetics

abstract: We experimentally study the emergence of collective bacterial swimming, a phenomenon often referred to as bacterial turbulence. A phase diagram of the flow of 3D E. coli suspensions spanned by bacterial concentration, the swimming speed of bacteria and the number fraction of active swimmers is systematically mapped, which shows quantitative agreement with kinetic theories and demonstrates the dominant role of hydrodynamic interactions in bacterial collective swimming. More importantly, we trigger bacterial turbulence by suddenly increasing the swimming speed of light-powered bacteria and image the transition to the turbulence in real time. Our experiments identify two unusual kinetic pathways, i.e., the one-step transition with long incubation periods near the phase boundary and the two-step transition driven by long-wavelength instabilities deep inside the turbulent phase. Our study provides not only a quantitative verification of existing theories, but also new insights into interparticle interactions and transition kinetics of bacterial turbulence.


title: Metabolic graphs, LIFE method and the modeling of drug action on Mycobacterium tuberculosis

abstract: This paper serves as a framework for designing advanced models for drug action on metabolism. Drug treatment may affect metabolism by either enhancing or inhibiting metabolic reactions comprising a metabolic network. We introduce the concept of \textit{metabolic graphs}, a generalization of hypergraphs having specialized features common to metabolic networks. Linear-in-flux-expression (briefly LIFE) is a methodology for analyzing metabolic networks and simulating virtual patients. We extend LIFE dynamics to be compatible with metabolic graphs, including the more complex interactions of enhancer and inhibitor molecules that affect biochemical reactions. We discuss results considering network structure required for existence and uniqueness of equilibria on metabolic graphs and show simulations of drug action on \textit{Mycobacterium tuberculosis} (briefly MTB)


title: Resilient Cyber-Physical Systems: Using NFV Orchestration

abstract: Cyber-Physical Systems (CPSs) are increasingly important in critical areas of our society such as intelligent power grids, next generation mobile devices, and smart buildings. CPS operation has characteristics including considerable heterogeneity, variable dynamics, and high complexity. These systems have also scarce resources in order to satisfy their entire load demand, which can be divided into data processing and service execution. These new characteristics of CPSs need to be managed with novel strategies to ensure their resilient operation. Towards this goal, we propose an SDN-based solution enhanced by distributed Network Function Virtualization (NFV) modules located at the top-most level of our solution architecture. These NFV agents will take orchestrated management decisions among themselves to ensure a resilient CPS configuration against threats, and an optimum operation of the CPS. For this, we study and compare two distinct incentive mechanisms to enforce cooperation among NFVs. Thus, we aim to offer novel perspectives into the management of resilient CPSs, embedding IoT devices, modeled by Game Theory (GT), using the latest software and virtualization platforms.


title: Fast Design of Plasmonic Metasurfaces Enabled by Deep Learning

abstract: Metasurfaces is an emerging field that enables the manipulation of light by an ultra-thin structure composed of sub-wavelength antennae and fulfills an important requirement for miniaturized optical elements. Finding a new design for a metasurface or optimizing an existing design for a desired functionality is a computationally expensive and time consuming process as it is based on an iterative process of trial and error. We propose a deep learning (DL) architecture dubbed bidirectional autoencoder for nanophotonic metasurface design via a template search methodology. In contrast with the earlier approaches based on DL, our methodology addresses optimization in the space of multiple metasurface topologies instead of just one, in order to tackle the one to many mapping problem of inverse design. We demonstrate the creation of a Geometry and Parameter Space Library (GPSL) of metasurface designs with their corresponding optical response using our DL model. This GPSL acts as a universal design and response space for the optimization. As an example application, we use our methodology to design a multi-band gap-plasmon based half-wave plate metasurface. Through this example, we demonstrate the power of our technique in addressing the non-uniqueness problem of common inverse design. Our network converges aptly to multiple metasurface topologies for the desired optical response with a low mean absolute error between desired optical response and the optical response of topologies searched. Our proposed technique would enable fast and accurate design and optimization of various kinds of metasurfaces with different functionalities.


title: Evolutionary Equations

abstract: This is the final version of the lecture notes of the 23rd Internet Seminar on Evolutionary Equations, see also https://www.mat.tuhh.de/isem23/.


title: Designing Refractive Index Fluids using the Kramers-Kronig Relations

abstract: For a number of optical applications, it is advantageous to precisely tune the refractive index of a liquid. Here, we harness a well-established concept in optics for this purpose. The Kramers-Kronig relation provides physical connection between the spectral variation of the (real) refractive index and the absorption coefficient. In particular a sharp spectral variation of the absorption coefficient gives rise to either an enhancement or reduction of the refractive index in the spectral vicinity of this variation. By using bright commodity dyes that fulfil this absorption requirement, we demonstrate the use of the Kramers-Kronig relation to predictively dial-in refractive index values in water solutions that are otherwise only attained by toxic specialised liquids.


title: Bayesian Sequential Joint Detection and Estimation under Multiple Hypotheses

abstract: We consider the problem of jointly testing multiple hypotheses and estimating a random parameter of the underlying distribution. This problem is investigated in a sequential setup under mild assumptions on the underlying random process. The optimal method minimizes the expected number of samples while ensuring that the average detection/estimation errors do not exceed a certain level. After converting the constrained problem to an unconstrained one, we characterize the general solution by a non-linear Bellman equation, which is parametrized by a set of cost coefficients. A strong connection between the derivatives of the cost function with respect to the coefficients and the detection/estimation errors of the sequential procedure is derived. Based on this fundamental property, we further show that for suitably chosen cost coefficients the solutions of the constrained and the unconstrained problem coincide. We present two approaches to finding the optimal coefficients. For the first approach, the final optimization problem is converted into a linear program, whereas the second approach solves it with a projected gradient ascent. To illustrate the theoretical results, we consider two problems for which the optimal schemes are designed numerically. Using Monte Carlo simulations, it is validated that the numerical results agree with the theory.


title: Learning Implicit Surface Light Fields

abstract: Implicit representations of 3D objects have recently achieved impressive results on learning-based 3D reconstruction tasks. While existing works use simple texture models to represent object appearance, photo-realistic image synthesis requires reasoning about the complex interplay of light, geometry and surface properties. In this work, we propose a novel implicit representation for capturing the visual appearance of an object in terms of its surface light field. In contrast to existing representations, our implicit model represents surface light fields in a continuous fashion and independent of the geometry. Moreover, we condition the surface light field with respect to the location and color of a small light source. Compared to traditional surface light field models, this allows us to manipulate the light source and relight the object using environment maps. We further demonstrate the capabilities of our model to predict the visual appearance of an unseen object from a single real RGB image and corresponding 3D shape information. As evidenced by our experiments, our model is able to infer rich visual appearance including shadows and specular reflections. Finally, we show that the proposed representation can be embedded into a variational auto-encoder for generating novel appearances that conform to the specified illumination conditions.


title: Disentangling different structures in heavy-light four-quark states

abstract: Models proposed to explain recently discovered heavy-light four-quark states already assume certain internal structures, i.e. the (anti)quark constituents are grouped into diquark/antidiquark clusters, heavy-meson/light-meson clusters (hadrocharmonium) or heavy-light meson molecules. We propose and use an approach to four-quark states based on Dyson-Schwinger and Bethe-Salpeter equations that has the potential to discriminate between these models. We study the masses of heavy-light $cq\bar{q}\bar{c}$ and $cc\bar{q}\bar{q}$ four-quark states with $q=u,d,s$ and quantum numbers $I(J^{PC})=0(1^{++}),1(1^{+-}),0(0^{++})$ and $1(0^+),0(1^+),1(1^+)$. We identify the dominant components of the ground states with these quantum numbers and suggest candidates for corresponding experimental states. Most notably, we find strong heavy-light meson-meson and negligible diquark-antidiquark components in all $cq\bar{q}\bar{c}$ states, whereas for $cc\bar{q}\bar{q}$ states diquarks are present. A potential caveat in the $I=0$ channels is the necessary but costly inclusion of $c\bar{c}$ components which is relegated to future work.


title: On the role of surrogates in the efficient estimation of treatment effects with limited outcome data

abstract: In many experiments and observational studies, the outcome of interest is often difficult or expensive to observe, reducing effective sample sizes for estimating average treatment effects (ATEs) even when identifiable. We study how incorporating data on units for which only surrogate outcomes not of primary interest are observed can increase the precision of ATE estimation. We refrain from imposing stringent surrogacy conditions, which permit surrogates as perfect replacements for the target outcome. Instead, we supplement the available, albeit limited, observations of the target outcome (which by themselves identify the ATE) with abundant observations of surrogate outcomes, without any assumptions beyond random assignment and missingness and corresponding overlap conditions. To quantify the potential gains, we derive the difference in efficiency bounds on ATE estimation with and without surrogates, both when an overwhelming or comparable number of units have missing outcomes. We develop robust ATE estimation and inference methods that realize these efficiency gains. We empirically demonstrate the gains by studying the long-term-earning effects of job training.


title: Electron correlation and short-range dynamics in attosecond angular streaking

abstract: We employ the R-matrix with time-dependence method to study attosecond angular streaking of F$^-$. Using this negative ion, free of long-range Coulomb interactions, we elucidate the role of short-range electron correlation effects in an attoclock scheme. Through solution of the multielectron time-dependent Schrodinger equation, we aim to bridge the gap between experiments using multielectron targets, and one-electron theoretical approaches. We observe significant negative offset angles in the photoelectron momentum distributions, despite the short-range nature of the binding potential. We show that the offset angle is sensitive to the atomic structure description of the residual F atom. We also investigate the response of co- and counter-rotating electrons, and observe an angular separation in their emission.


title: Urban Planning in the First Unfortified Spanish Colonial Town: The orientation of the historic churches of San Cristobal de La Laguna

abstract: The city of San Cristobal de La Laguna in the Canary Island of Tenerife (Spain) has an exceptional value due to the original conception of its plan. It is an urban system in a grid, outlined by straight streets that form squares, its layout being the first case of an unfortified colonial city with a regular plan in the overseas European expansion. It constitutes a historical example of the so-called "Town of Peace", the archetype of a city-republic in a new land that employed its own natural boundaries to delimit and defend itself. Founded in 1496, the historical centre of the old city was declared a World Heritage Site by UNESCO in 1999. We analyse the exact spatial orientation of twenty-one historic Christian churches currently existing in the old part of La Laguna which we take as a good indicator of the original layout of the urban lattice. We find a clear orientation pattern that, if correlated with the rising or setting Sun, singles out an absolute-value astronomical declination slightly below 20 degrees, which, within the margin of error of our study, might be associated with the July 25th feast-day of San Cristobal de Licia, the saint to whom the town was originally dedicated. We also discuss at some length some recent proposals which invoke somewhat far-fetched hypotheses for the planimetry of the old city and finish up with some comments on one of its outstanding features, namely its Latin-cross structure, which is apparent in the combined layout of some of its most emblematic churches.


title: Transition Models for Count Data: a Flexible Alternative to Fixed Distribution Models

abstract: A flexible semiparametric class of models is introduced that offers an alternative to classical regression models for count data as the Poisson and negative binomial model, as well as to more general models accounting for excess zeros that are also based on fixed distributional assumptions. The model allows that the data itself determine the distribution of the response variable, but, in its basic form, uses a parametric term that specifies the effect of explanatory variables. In addition, an extended version is considered, in which the effects of covariates are specified nonparametrically. The proposed model and traditional models are compared by utilizing several real data applications.


title: Algebraic models of change of groups functors in (co)free rational equivariant spectra

abstract: Free and cofree equivariant spectra are important classes of equivariant spectra which represent equivariant cohomology theories on free equivariant spaces. Greenlees-Shipley and Pol and the author have given an algebraic model for rational (co)free equivariant spectra. In this paper, we extend this framework by proving that the Quillen functors of induction-restriction-coinduction between categories of (co)free rational equivariant spectra correspond to Quillen functors between the algebraic models in the case of connected compact Lie groups. This is achieved using new abstract techniques regarding correspondences of Quillen functors along Quillen equivalences, which we expect to be of use in other applications.


title: Specht's invariant and localization of operator tuples

abstract: We introduce a set of operator-valued invariants for localization of operator tuples in the Cowen-Douglas class, with which a Specht-type criterion for unitary equivalence is obtained.


title: Shock fluctuations in TASEP under a variety of time scalings

abstract: We consider the totally asymmetric simple exclusion process (TASEP) with two different initial conditions with shock discontinuities formed by blocks of fully packed particles. Initially a second class particle is at the left of a shock discontinuity. Using multicolored TASEP we derive exact formulas for the distribution of the second class particle and colored height functions. These are given in terms of the height function at different positions of a single TASEP configuration. We study the limiting distributions of second class particles (and colored height functions). The result depends on how the width blocks of particles scale with the observation time; we study a variety of such scalings.


title: Learning representations in Bayesian Confidence Propagation neural networks

abstract: Unsupervised learning of hierarchical representations has been one of the most vibrant research directions in deep learning during recent years. In this work we study biologically inspired unsupervised strategies in neural networks based on local Hebbian learning. We propose new mechanisms to extend the Bayesian Confidence Propagating Neural Network (BCPNN) architecture, and demonstrate their capability for unsupervised learning of salient hidden representations when tested on the MNIST dataset.


title: Multiwavelength morphological study of active galaxies

abstract: Studying the morphology of a large sample of active galaxies at different wavelengths and comparing it with active galactic nuclei (AGN) properties, such as black hole mass ($M_{BH}$) and Eddington ratio ($\lambda_{Edd}$), can help us in understanding better the connection between AGN and their host galaxies and the role of nuclear activity in galaxy formation and evolution. By using the BAT-SWIFT hard X-ray public data and by extracting those parameters measured for AGN and by using other public catalogues for parameters such as stellar mass ($M_*$), star formation rate (SFR), bolometric luminosity ($L_{bol}$), etc., we studied the multiwavelength morphological properties of host galaxies of ultra-hard X-ray detected AGN and their correlation with other AGN properties. We found that ultra hard X-ray detected AGN can be hosted by all morphological types, but in larger fractions (42%) they seem to be hosted by spirals in optical, to be quiet in radio, and to have compact morphologies in X-rays. When comparing morphologies with other galaxy properties, we found that ultra hard X-ray detected AGN follow previously obtained relations. On the SFR vs. stellar mass diagram, we found that although the majority of sources are located below the main sequence (MS) of star formation (SF), still non-negligible number of sources, with diverse morphologies, is located on and/or above the MS, suggesting that AGN feedback might have more complex influence on the SF in galaxies than simply quenching it, as it was suggested in some of previous studies.


title: Temperature dependence of COVID-19 transmission

abstract: The recent coronavirus pandemic follows in its early stages an almost exponential growth, with the number of cases quite well fit in time by $N(t)\propto e^{\alpha t}$, in many countries. We analyze the rate $\alpha$ for each country, starting from a threshold of 30 total cases and using the next 12 days, capturing thus the early growth homogeneously. We look for a link between $\alpha$ and the average temperature $T$ of each country, in the month of the epidemic growth. We analyze a {\it base} set of 42 countries, which developed the epidemic earlier, an {\it intermediate} set of 88 countries and an {\it extended} set of 125 countries, which developed the epidemic more recently. Applying a linear fit $\alpha(T)$, we find increasing evidence for a decreasing $\alpha$ as a function of $T$, at $99.66\%$C.L., $99.86\%$C.L. and $99.99995 \%$ C.L. ($p$-value $5 \cdot 10^{-7}$, or 5$\sigma$ detection) in the {\it base}, {\it intermediate} and {\it extended} dataset, respectively. The doubling time is expected to increase by $40\%\sim 50\%$, going from $5^\circ$ C to $25^\circ$ C. In the {\it base} set, going beyond a linear model, a peak at $(7.7\pm 3.6)^\circ C$ seems to be present, but its evidence disappears for the larger datasets. We also analyzed a possible bias: poor countries, often located in warm regions, might have less intense testing. By excluding countries below a given GDP per capita, we find that our conclusions are only slightly affected and only for the {\it extended} dataset. The significance remains high, with a $p$-value of $10^{-3}-10^{-4}$ or less. Our findings give hope that, for northern hemisphere countries, the growth rate should significantly decrease as a result of both warmer weather and lockdown policies. In general the propagation should be hopefully stopped by strong lockdown, testing and tracking policies, before the arrival of the cold season.


title: Efficient description of many-body systems with Matrix Product Density Operators

abstract: Matrix Product States form the basis of powerful simulation methods for ground state problems in one dimension. Their power stems from the fact that they faithfully approximate states with a low amount of entanglement, the "area law". In this work, we establish the mixed state analogue of this result: We show that one-dimensional mixed states with a low amount of entanglement, quantified by the entanglement of purification, can be efficiently approximated by Matrix Product Density Operators (MPDOs). In combination with results establishing area laws for thermal states, this helps to put the use of MPDOs in the simulation of thermal states on a formal footing.


title: Tight Bounds on the Coeffcients of Consecutive $k$-out-of-$n$:$F$ Systems

abstract: In this paper we compute the coefficients of the reliability polynomial of a consecutive-$k$-out-of-$n$:$F$ system, in Bernstein basis, using the generalized Pascal coefficients. Based on well-known combinatorial properties of the generalized Pascal triangle we determine simple closed formulae for the reliability polynomial of a consecutive system for particular ranges of $k$. Moreover, for the remaining ranges of $k$ (where we were not able to determine simple closed formulae), we establish easy to calculate sharp bounds for the reliability polynomial of a consecutive system.


title: On the notion of exact sequence: from Hopf algebras to tensor categories

abstract: We present an overview of the notions of exact sequences of Hopf algebras and tensor categories and their connections. We also present some examples illustrating their main features; these include simple fusion categories and a natural question regarding composition series of finite tensor categories.


title: Charm Physics Confronts High-$p_T$ Lepton Tails

abstract: We present a systematic survey of possible short-distance new-physics effects in (semi)leptonic charged- and neutral-current charmed meson decays. Using the Standard Model Effective Field Theory (SMEFT) to analyze the most relevant experimental data at low and high energies, we demonstrate a striking complementarity between charm decays and high invariant mass lepton tails at the LHC. Interestingly enough, high-$p_T$ Drell-Yan data offer competitive constraints on most new physics scenarios. Furthermore, the full set of correlated constraints from $K$, $\pi$ and $\tau$ decays imposed by $SU(2)_L$ gauge invariance is considered. The bounds from $D_{(s)}$ decays, high-$p_T$ lepton tails and $SU(2)_L$ relations chart the space of the SMEFT affecting semi(leptonic) charm flavor transitions.


title: Singular Euler-Maclaurin expansion

abstract: We present the singular Euler--Maclaurin expansion, a new method for the efficient computation of large singular sums that appear in long-range interacting systems in condensed matter and quantum physics. In contrast to the traditional Euler--Maclaurin summation formula, the new method is applicable also to the product of a differentiable function and a singularity. For suitable non-singular functions, we show that the approximation error decays exponentially in the expansion order and polynomially in the characteristic length scale of the non-singular function, where precise error estimates are provided. The sum is approximated by an integral plus a differential operator acting on the non-singular function factor only. The singularity furthermore is included in a generalisation of the Bernoulli polynomials that form the coefficients of the differential operator. We demonstrate the numerical performance of the singular Euler--Maclaurin expansion by applying it to the computation of the full non-linear long-range forces inside a macroscopic one-dimensional crystal with $2\times 10^{10}$ particles. A reference implementation in Mathematica is provided online.


title: A Hybrid-Order Distributed SGD Method for Non-Convex Optimization to Balance Communication Overhead, Computational Complexity, and Convergence Rate

abstract: In this paper, we propose a method of distributed stochastic gradient descent (SGD), with low communication load and computational complexity, and still fast convergence. To reduce the communication load, at each iteration of the algorithm, the worker nodes calculate and communicate some scalers, that are the directional derivatives of the sample functions in some \emph{pre-shared directions}. However, to maintain accuracy, after every specific number of iterations, they communicate the vectors of stochastic gradients. To reduce the computational complexity in each iteration, the worker nodes approximate the directional derivatives with zeroth-order stochastic gradient estimation, by performing just two function evaluations rather than computing a first-order gradient vector. The proposed method highly improves the convergence rate of the zeroth-order methods, guaranteeing order-wise faster convergence. Moreover, compared to the famous communication-efficient methods of model averaging (that perform local model updates and periodic communication of the gradients to synchronize the local models), we prove that for the general class of non-convex stochastic problems and with reasonable choice of parameters, the proposed method guarantees the same orders of communication load and convergence rate, while having order-wise less computational complexity. Experimental results on various learning problems in neural networks applications demonstrate the effectiveness of the proposed approach compared to various state-of-the-art distributed SGD methods.

categories: cs.LG cs.DC cs.IT math.IT math.OC stat.ML


title: Weakly-Supervised Action Localization by Generative Attention Modeling

abstract: Weakly-supervised temporal action localization is a problem of learning an action localization model with only video-level action labeling available. The general framework largely relies on the classification activation, which employs an attention model to identify the action-related frames and then categorizes them into different classes. Such method results in the action-context confusion issue: context frames near action clips tend to be recognized as action frames themselves, since they are closely related to the specific classes. To solve the problem, in this paper we propose to model the class-agnostic frame-wise probability conditioned on the frame attention using conditional Variational Auto-Encoder (VAE). With the observation that the context exhibits notable difference from the action at representation level, a probabilistic model, i.e., conditional VAE, is learned to model the likelihood of each frame given the attention. By maximizing the conditional probability with respect to the attention, the action and non-action frames are well separated. Experiments on THUMOS14 and ActivityNet1.2 demonstrate advantage of our method and effectiveness in handling action-context confusion problem. Code is now available on GitHub.


title: Mic2Mic: Using Cycle-Consistent Generative Adversarial Networks to Overcome Microphone Variability in Speech Systems

abstract: Mobile and embedded devices are increasingly using microphones and audio-based computational models to infer user context. A major challenge in building systems that combine audio models with commodity microphones is to guarantee their accuracy and robustness in the real-world. Besides many environmental dynamics, a primary factor that impacts the robustness of audio models is microphone variability. In this work, we propose Mic2Mic -- a machine-learned system component -- which resides in the inference pipeline of audio models and at real-time reduces the variability in audio data caused by microphone-specific factors. Two key considerations for the design of Mic2Mic were: a) to decouple the problem of microphone variability from the audio task, and b) put a minimal burden on end-users to provide training data. With these in mind, we apply the principles of cycle-consistent generative adversarial networks (CycleGANs) to learn Mic2Mic using unlabeled and unpaired data collected from different microphones. Our experiments show that Mic2Mic can recover between 66% to 89% of the accuracy lost due to microphone variability for two common audio tasks.