title: Inductive biases, pretraining and fine-tuning jointly account for brain responses to speech

abstract: Our ability to comprehend speech remains, to date, unrivaled by deep learning models. This feat could result from the brain's ability to fine-tune generic sound representations for speech-specific processes. To test this hypothesis, we compare i) five types of deep neural networks to ii) human brain responses elicited by spoken sentences and recorded in 102 Dutch subjects using functional Magnetic Resonance Imaging (fMRI). Each network was either trained on an acoustics scene classification, a speech-to-text task (based on Bengali, English, or Dutch), or not trained. The similarity between each model and the brain is assessed by correlating their respective activations after an optimal linear projection. The differences in brain-similarity across networks revealed three main results. First, speech representations in the brain can be accounted for by random deep networks. Second, learning to classify acoustic scenes leads deep nets to increase their brain similarity. Third, learning to process phonetically-related speech inputs (i.e., Dutch vs English) leads deep nets to reach higher levels of brain-similarity than learning to process phonetically-distant speech inputs (i.e. Dutch vs Bengali). Together, these results suggest that the human brain fine-tunes its heavily-trained auditory hierarchy to learn to process speech.


title: Tax Evasion Risk Management Using a Hybrid Unsupervised Outlier Detection Method

abstract: Big data methods are becoming an important tool for tax fraud detection around the world. Unsupervised learning approach is the dominant framework due to the lack of label and ground truth in corresponding data sets although these methods suffer from low interpretability. HUNOD, a novel hybrid unsupervised outlier detection method for tax evasion risk management, is presented in this paper. In contrast to previous methods proposed in the literature, the HUNOD method combines two outlier detection approaches based on two different machine learning designs (i.e, clustering and representational learning) to detect and internally validate outliers in a given tax dataset. The HUNOD method allows its users to incorporate relevant domain knowledge into both constituent outlier detection approaches in order to detect outliers relevant for a given economic context. The interpretability of obtained outliers is achieved by training explainable-by-design surrogate models over results of unsupervised outlier detection methods. The experimental evaluation of the HUNOD method is conducted on two datasets derived from the database on individual personal income tax declarations collected by the Tax Administration of Serbia. The obtained results show that the method indicates between 90% and 98% internally validated outliers depending on the clustering configuration and employed regularization mechanisms for representational learning.


title: Differential wavefront sensing and control using radio-frequency optical demodulation

abstract: Differential wavefront sensing is an essential technique for optimising the performance of many precision interferometric experiments. Perhaps the most extensive application of this is for alignment sensing using radio-frequency beats measured with quadrant photodiodes. Here we present a new technique that uses optical demodulation to measure such optical beats at significantly higher resolutions using commercial laboratory equipment. We experimentally demonstrate that the images captured can be digitally processed to generate wavefront error signals and use these in a closed loop control system for correct wavefront errors for alignment and mode-matching a beam into an optical cavity to 99.9\%. This experiment paves the way for the correction of even higher order errors when paired with higher order wavefront actuators. Such a sensing scheme could find use in optimizing complex interferometers consisting of coupled cavities, such as those found in gravitational wave detectors, or simply just for sensing higher order wavefront errors in heterodyne interferometric table-top experiments.


title: If Only We Had Better Counterfactual Explanations: Five Key Deficits to Rectify in the Evaluation of Counterfactual XAI Techniques

abstract: In recent years, there has been an explosion of AI research on counterfactual explanations as a solution to the problem of eXplainable AI (XAI). These explanations seem to offer technical, psychological and legal benefits over other explanation techniques. We survey 100 distinct counterfactual explanation methods reported in the literature. This survey addresses the extent to which these methods have been adequately evaluated, both psychologically and computationally, and quantifies the shortfalls occurring. For instance, only 21% of these methods have been user tested. Five key deficits in the evaluation of these methods are detailed and a roadmap, with standardised benchmark evaluations, is proposed to resolve the issues arising; issues, that currently effectively block scientific progress in this field.


title: The geometric classification of $2$-step nilpotent algebras and applications

abstract: We give a geometric classification of complex $n$-dimensional $2$-step nilpotent (all, commutative and anticommutative) algebras. Namely, has been found the number of irreducible components and their dimensions. As a corollary, we have a geometric classification of complex $5$-dimensional nilpotent associative algebras. In particular, it has been proven that this variety has $14$ irreducible components and $9$ rigid algebras.


title: Complete $\alpha^7\,m$ Lamb shift of helium triplet states

abstract: We have derived the complete formula for the $\alpha^7\,m$ contribution to energy levels of an arbitrary triplet state of the helium atom, performed numerical calculations for the $2^3S$ and $2^3P$ states, and thus improved the theoretical accuracy of ionization energies of these states by more than an order of magnitude. Using the nuclear charge radius extracted from the muonic helium Lamb shift, we obtain the theoretical prediction in excellent agreement with the measured $2^3S - 2^3P$ transition energy [X.~Zheng et al., Phys. Rev. Lett. {\bf 199}, 263002 (2017)]. At the same time we observe significant discrepancies with experiments for the $2^3S- 3^3D$ and $2^3P - 3^3D$ transitions.


title: Low-Order Modeling and High-Fidelity Simulations for the Prediction of Combustion Instabilities in Liquid Rocket Engines and Gas Turbines

abstract: Combustion instabilities are a major concern in the design of Liquid Rocket Engines (LREs) and gas turbines. During this PhD work, several directions were explored to understand and mitigate their effects. First, more efficient and robust numerical methods for their prediction in complex combustors were designed. In this matter, a novel type of modal expansion, named a frame expansion and comparable to the classical Galerkin expansion, was introduced to build more accurate acoustic Low-Order Models (LOMs), able to account for the full geometrical complexity of industrial combustors. In particular, the frame expansion is able to accurately represent the acoustic velocity field near non-rigid-wall boundaries, a crucial ability that the Galerkin method lacks. An entire class of novel numerical methods, based on the frame expansion, were then designed and combined with the state-space formalism to build acoustic networks of complex systems. The second ingredient in the prediction of thermoacoustic instabilities is the flame dynamics modeling. This work dealt with this problem, in the specific case of a cryogenic coaxial jet-flame characteristic of a LRE. Flame dynamics driving phenomena were identified thanks to three-dimensional Large Eddy Simulations (LES) of the Mascotte experimental test rig where both reactants (CH4 and O2) are injected in transcritical conditions. Several LES with harmonic modulation of the fuel inflow at various frequencies and amplitudes were performed in order to evaluate the flame response to acoustic oscillations and compute a Flame Transfer Function (FTF). The stabilization of this flame in the near-injector region, which is of primary importance on the overall flame dynamics, was also investigated thanks to multi-physics two-dimensional Direct Numerical Simulations (DNS), where a conjugate heat transfer problem is resolved at the injector lip.


title: Self-Supervised Simultaneous Multi-Step Prediction of Road Dynamics and Cost Map

abstract: While supervised learning is widely used for perception modules in conventional autonomous driving solutions, scalability is hindered by the huge amount of data labeling needed. In contrast, while end-to-end architectures do not require labeled data and are potentially more scalable, interpretability is sacrificed. We introduce a novel architecture that is trained in a fully self-supervised fashion for simultaneous multi-step prediction of space-time cost map and road dynamics. Our solution replaces the manually designed cost function for motion planning with a learned high dimensional cost map that is naturally interpretable and allows diverse contextual information to be integrated without manual data labeling. Experiments on real world driving data show that our solution leads to lower number of collisions and road violations in long planning horizons in comparison to baselines, demonstrating the feasibility of fully self-supervised prediction without sacrificing either scalability or interpretability.


title: On Vietoris--Rips complexes of hypercube graphs

abstract: We describe the homotopy types of Vietoris-Rips complexes of hypercube graphs at small scale parameters. In more detail, let $Q_n$ be the vertex set of the hypercube graph with $2^n$ vertices, equipped with the shortest path metric. Equivalently, $Q_n$ is the set of all binary strings of length $n$, equipped with the Hamming distance. The Vietoris-Rips complex of $Q_n$ at scale parameter zero is $2^n$ points, and the Vietoris-Rips complex of $Q_n$ at scale parameter one is the hypercube graph, which is homotopy equivalent to a wedge sum of circles. We show that the Vietoris-Rips complex of $Q_n$ at scale parameter two is homotopy equivalent to a wedge sum of 3-spheres, and furthermore we provide a formula for the number of 3-spheres. Many questions about the Vietoris-Rips complexes of $Q_n$ at larger scale parameters remain open.


title: The Rise of a New Digital Third Space Professional in Higher Education: Recognising Research Software Engineering

abstract: Research Software Engineering is the application of professional software skills to research problems. Those who do this are called Research Software Engineers or RSEs for short. RSEs work closely with researchers in a collaborative fashion rather than just offering a standalone function (c.f. the traditional IT workforce or Librarians working to provide a general set of services to the University community such as research, teaching or administrative functions). It is this overlap with academic researchers that make the RSE and the RSE management a new type of third space professional in the higher education sector. We explore aspects of knowledge, relationships, legitimacies and language in relation to the model constructed by Whitchurch in Reconstructing Identities in Higher Education to explore how these relate to the RSE role and go on to highlight open problems that need resolving to put RSEs on a firmer organisational footing.


title: [CII] emission properties of the massive star-forming region RCW36 in a filamentary molecular cloud

abstract: Aims: To investigate properties of [CII]158 $\mu$m emission of RCW36 in a dense filamentary cloud. Methods: [CII] observations of RCW36 covering an area of ~30 arcmin$\times$30 arcmin were carried out with a Fabry-P\'{e}rot spectrometer aboard a 100-cm balloon-borne far-infrared (IR) telescope with an angular resolution of 90 arcsec. By using AKARI and Herschel images, the spatial distribution of the [CII] intensity was compared with those of emission from the large grains and PAH. Results: The [CII] emission is spatially in good agreement with shell-like structures of a bipolar lobe observed in IR images, which extend along the direction perpendicular to the direction of a cold dense filament. We found that the [CII]--160 $\mu$m relation for RCW36 shows higher brightness ratio of [CII]/160 $\mu$m than that for RCW 38, while the [CII]--9 $\mu$m relation for RCW36 is in good agreement with that for RCW38. Conclusions: The [CII] emission spatially well correlates with PAH and cold dust emissions. This means that the observed [CII] emission dominantly comes from PDRs. Moreover, the L_[CII]/L_FIR ratio shows large variation compared with the L_[CII]/L_PAH ratio. In view of the observed tight correlation between L_[CII]/L_FIR and the optical depth at $\lambda$=160 $\mu$m, the large variation in L_[CII]/L_FIR can be simply explained by the geometrical effect, viz., L_FIR has contributions from the entire dust-cloud column along the line of sight, while L_[CII] has contributions from far-UV illuminated cloud surfaces. Based on the picture of the geometry effect, the enhanced brightness ratio of [CII]/160 $\mu$m is attributed to the difference in gas structures where massive stars are formed: filamentary (RCW36) and clumpy (RCW38) molecular clouds and thus suggests that RCW36 is dominated by far-UV illuminated cloud surfaces compared with RCW38.


title: Persistent Message Passing

abstract: Graph neural networks (GNNs) are a powerful inductive bias for modelling algorithmic reasoning procedures and data structures. Their prowess was mainly demonstrated on tasks featuring Markovian dynamics, where querying any associated data structure depends only on its latest state. For many tasks of interest, however, it may be highly beneficial to support efficient data structure queries dependent on previous states. This requires tracking the data structure's evolution through time, placing significant pressure on the GNN's latent representations. We introduce Persistent Message Passing (PMP), a mechanism which endows GNNs with capability of querying past state by explicitly persisting it: rather than overwriting node representations, it creates new nodes whenever required. PMP generalises out-of-distribution to more than 2x larger test inputs on dynamic temporal range queries, significantly outperforming GNNs which overwrite states.


abstract: Cross-border security is of topmost priority for societies. Economies lose billions each year due to counterfeiters and other threats. Security checkpoints equipped with X-ray Security Systems (NIIS-Non-Intrusive Inspection Systems) like airports, ports, border control and customs authorities tackle the myriad of threats by using NIIS to inspect bags, air, land, sea and rail cargo, and vehicles. The reliance on the X-ray scanning systems necessitates their continuous 24/7 functioning being provided for. Hence the need for their working condition being closely monitored and preemptive actions being taken to reduce the overall X-ray systems downtime. In this paper, we present a predictive maintenance decision support system, abbreviated as PMT4NIIS (Predictive Maintenance Tool for Non-Intrusive Inspection Systems), which is a kind of augmented analytics platforms that provides real-time AI-generated warnings for upcoming risk of system malfunctioning leading to possible downtime. The industrial platform is the basis of a 24/7 Service Desk and Monitoring center for the working condition of various X-ray Security Systems.


title: Computing the Information Content of Trained Neural Networks

abstract: How much information does a learning algorithm extract from the training data and store in a neural network's weights? Too much, and the network would overfit to the training data. Too little, and the network would not fit to anything at all. Na\"ively, the amount of information the network stores should scale in proportion to the number of trainable weights. This raises the question: how can neural networks with vastly more weights than training data still generalise? A simple resolution to this conundrum is that the number of weights is usually a bad proxy for the actual amount of information stored. For instance, typical weight vectors may be highly compressible. Then another question occurs: is it possible to compute the actual amount of information stored? This paper derives both a consistent estimator and a closed-form upper bound on the information content of infinitely wide neural networks. The derivation is based on an identification between neural information content and the negative log probability of a Gaussian orthant. This identification yields bounds that analytically control the generalisation behaviour of the entire solution space of infinitely wide networks. The bounds have a simple dependence on both the network architecture and the training data. Corroborating the findings of Valle-P\'erez et al. (2019), who conducted a similar analysis using approximate Gaussian integration techniques, the bounds are found to be both non-vacuous and correlated with the empirical generalisation behaviour at finite width.


title: Extending Prolog for Quantified Boolean Horn Formulas

abstract: Prolog is a well known declarative programming language based on propositional Horn formulas. It is useful in various areas, including artificial intelligence, automated theorem proving, mathematical logic and so on. An active research area for many years is to extend Prolog to larger classes of logic. Some important extensions of it includes the constraint logic programming, and the object oriented logic programming. However, it cannot solve problems having arbitrary quantified Horn formulas. To be precise, the facts, rules and queries in Prolog are not allowed to have arbitrary quantified variables. The paper overcomes this major limitations of Prolog by extending it for the quantified Boolean Horn formulas. We achieved this by extending the SLD-resolution proof system for quantified Boolean Horn formulas, followed by proposing an efficient model for implementation. The paper shows that the proposed implementation also supports the first-order predicate Horn logic with arbitrary quantified variables. The paper also introduces for the first time, a declarative programming for the quantified Boolean Horn formulas.


title: Unified topological characterization of electronic states in spin textures from noncommutative K-theory

abstract: The nontrivial topology of spin systems such as skyrmions in real space can promote complex electronic states. Here, we provide a general viewpoint at the emergence of topological electronic states in spin systems based on the methods of noncommutative K-theory. By realizing that the structure of the observable algebra of spin textures is determined by the algebraic properties of the noncommutative hypertorus, we arrive at a unified understanding of topological electronic states which we predict to arise in various noncollinear setups. The power of our approach lies in an ability to categorize emergent topological states algebraically without referring to smooth real- or reciprocal-space quantities. This opens a way towards an educated design of topological phases in aperiodic, disordered, or non-smooth textures of spins and charges containing topological defects.


title: High-productivity, high-performance workflow for virus-scale electrostatic simulations with Bempp-Exafmm

abstract: Biomolecular electrostatics is key in protein function and the chemical processes affecting it. Implicit-solvent models via the Poisson-Boltzmann (PB) equation provide insights with less computational cost than atomistic models, making large-system studies -- at the scale of viruses -- accessible to more researchers. Here we present a high-productivity and high-performance linear PB solver based on Exafmm, a fast multipole method library, and Bempp, a Galerkin boundary element method package. The workflow integrates an easy-to-use Python interface with optimized computational kernels, and can be run interactively via Jupyter notebooks, for faster prototyping. Our results show the capability of the software, confirm code correctness, and assess performance with between 8,000 and 2 million elements. Showcasing the power of this interactive computing platform, we study the conditioning of two variants of the boundary integral formulation with just a few lines of code. Mesh-refinement studies confirm convergence as $1/N$, for $N$ boundary elements, and a comparison with results from the trusted APBS code using various proteins shows agreement. Our binding energy calculations using 9 various complexes align with the results from using five other grid-based PB solvers. Performance results include timings, breakdowns, and computational complexity. Exafmm offers evaluation speeds of just a few seconds for tens of millions of points, and $\mathcal{O}(N)$ scaling. The trend observed in our performance comparison with APBS demonstrates the advantage of Bempp-Exafmm in applications involving larger structures or requiring higher accuracy. Computing the solvation free energy of a Zika virus, represented by 1.6 million atoms and 10 million boundary elements, took 80-min runtime on a single compute node (dual 20-core).


title: Diversifying Sample Generation for Accurate Data-Free Quantization

abstract: Quantization has emerged as one of the most prevalent approaches to compress and accelerate neural networks. Recently, data-free quantization has been widely studied as a practical and promising solution. It synthesizes data for calibrating the quantized model according to the batch normalization (BN) statistics of FP32 ones and significantly relieves the heavy dependency on real training data in traditional quantization methods. Unfortunately, we find that in practice, the synthetic data identically constrained by BN statistics suffers serious homogenization at both distribution level and sample level and further causes a significant performance drop of the quantized model. We propose Diverse Sample Generation (DSG) scheme to mitigate the adverse effects caused by homogenization. Specifically, we slack the alignment of feature statistics in the BN layer to relax the constraint at the distribution level and design a layerwise enhancement to reinforce specific layers for different data samples. Our DSG scheme is versatile and even able to be applied to the state-of-the-art post-training quantization method like AdaRound. We evaluate the DSG scheme on the large-scale image classification task and consistently obtain significant improvements over various network architectures and quantization methods, especially when quantized to lower bits (e.g., up to 22% improvement on W4A4). Moreover, benefiting from the enhanced diversity, models calibrated by synthetic data perform close to those calibrated by real data and even outperform them on W4A4.


title: Dual Attention Suppression Attack: Generate Adversarial Camouflage in Physical World

abstract: Deep learning models are vulnerable to adversarial examples. As a more threatening type for practical deep learning systems, physical adversarial examples have received extensive research attention in recent years. However, without exploiting the intrinsic characteristics such as model-agnostic and human-specific patterns, existing works generate weak adversarial perturbations in the physical world, which fall short of attacking across different models and show visually suspicious appearance. Motivated by the viewpoint that attention reflects the intrinsic characteristics of the recognition process, this paper proposes the Dual Attention Suppression (DAS) attack to generate visually-natural physical adversarial camouflages with strong transferability by suppressing both model and human attention. As for attacking, we generate transferable adversarial camouflages by distracting the model-shared similar attention patterns from the target to non-target regions. Meanwhile, based on the fact that human visual attention always focuses on salient items (e.g., suspicious distortions), we evade the human-specific bottom-up attention to generate visually-natural camouflages which are correlated to the scenario context. We conduct extensive experiments in both the digital and physical world for classification and detection tasks on up-to-date models (e.g., Yolo-V5) and significantly demonstrate that our method outperforms state-of-the-art methods.


title: Spin$^c$ structures on Hantzsche-Wendt manifolds

abstract: Using a combinatorial description of Stiefel-Whitney classes of closed flat manifolds with diagonal holonomy representation, we show that no Hantzsche-Wendt manifold of dimension greater than three does not admit a spin$^c$ structure.


title: On the Cost of Unsuccessful Searches in Search Trees with Two-way Comparisons

abstract: Search trees are commonly used to implement access operations to a set of stored keys. If this set is static and the probabilities of membership queries are known in advance, then one can precompute an optimal search tree, namely one that minimizes the expected access cost. For a non-key query, a search tree can determine its approximate location by returning the inter-key interval containing the query. This is in contrast to other dictionary data structures, like hash tables, that only report a failed search. We address the question "what is the additional cost of determining approximate locations for non-key queries"? We prove that for two-way comparison trees this additional cost is at most 1. Our proof is based on a novel probabilistic argument that involves converting a search tree that does not identify non-key queries into a random tree that does.


title: High Accuracy Visible Light Positioning Based on Multi-target Tracking Algorithm

abstract: In this paper, we propose a multi-target image tracking algorithm based on continuously apative mean-shift (Cam-shift) and unscented Kalman filter. We improved the single-lamp tracking algorithm proposed in our previous work to multi-target tracking, and achieved better robustness in the case of occlusion, the real-time performance to complete one positioning and relatively high accuracy by dynamically adjusting the weights of the multi-target motion states. Our previous algorithm is limited to the analysis of tracking error. In this paper, the results of the tracking algorithm are evaluated with the tracking error we defined. Then combined with the double-lamp positioning algorithm, the real position of the terminal is calculated and evaluated with the positioning error we defined. Experiments show that the defined tracking error is 0.61cm and the defined positioning error for 3-D positioning is 3.29cm with the average processing time of 91.63ms per frame. Even if nearly half of the LED area is occluded, the tracking error remains at 5.25cm. All of this shows that the proposed visible light positioning (VLP) method can track multiple targets for positioning at the same time with good robustness, real-time performance and accuracy. In addition, the definition and analysis of tracking errors and positioning errors indicates the direction for future efforts to reduce errors.


title: Weakly bound $H$ dibaryon from SU(3)-flavor-symmetric QCD

abstract: We present the first study of baryon-baryon interactions in the continuum limit of lattice QCD, finding unexpectedly large lattice artifacts. Specifically, we determine the binding energy of the $H$ dibaryon at a single quark-mass point. The calculation is performed at six values of the lattice spacing $a$, using O($a$)-improved Wilson fermions at the SU(3)-symmetric point with $m_\pi=m_K\approx 420$ MeV. Energy levels are extracted by applying a variational method to correlation matrices of bilocal two-baryon interpolating operators computed using the distillation technique. Our analysis employs L\"uscher's finite-volume quantization condition to determine the scattering phase shifts from the spectrum and vice versa, both above and below the two-baryon threshold. We perform global fits to the lattice spectra using parametrizations of the phase shift, supplemented by terms describing discretization effects, then extrapolate the lattice spacing to zero. The phase shift and the binding energy determined from it are found to be strongly affected by lattice artifacts. Our estimate of the binding energy in the continuum limit of three-flavor QCD is $B_H^{\text{SU(3)}_{\rm f}}=4.56\pm1.13_{\rm stat}\pm0.63_{\rm syst}$ MeV.


title: P2-Net: Joint Description and Detection of Local Features for Pixel and Point Matching

abstract: Accurately describing and detecting 2D and 3D keypoints is crucial to establishing correspondences across images and point clouds. Despite a plethora of learning-based 2D or 3D local feature descriptors and detectors having been proposed, the derivation of a shared descriptor and joint keypoint detector that directly matches pixels and points remains under-explored by the community. This work takes the initiative to establish fine-grained correspondences between 2D images and 3D point clouds. In order to directly match pixels and points, a dual fully convolutional framework is presented that maps 2D and 3D inputs into a shared latent representation space to simultaneously describe and detect keypoints. Furthermore, an ultra-wide reception mechanism in combination with a novel loss function are designed to mitigate the intrinsic information variations between pixel and point local regions. Extensive experimental results demonstrate that our framework shows competitive performance in fine-grained matching between images and point clouds and achieves state-of-the-art results for the task of indoor visual localization. Our source code will be available at [no-name-for-blind-review].


title: Probing non-Gaussianities with the high frequency tail of induced gravitational waves

abstract: We investigate in detail the spectrum of gravitational waves induced by a peaked primordial curvature power spectrum generated in single field inflationary models. We argue that the $f_{\rm NL}$ parameter can be inferred by measuring the high frequency spectral tilt of the induced gravitational waves. We also show that the intrinsically non-Gaussian impact of $f_{\rm NL}$ in $\Omega_{\rm GW}$ is to broaden its peak, although at a negligible level in order not to overproduce primordial black holes. We discuss possible degeneracies in the high frequency spectral tilt between $f_{\rm NL}$ and a general equation of state of the universe $w$. Finally, we discuss the constraints on the amplitude, peak and slope (or equivalently, $f_{\rm NL}$) of the primordial power spectrum by combining current and future gravitational wave experiments with limits on $\mu$ distortions from the cosmic microwave background.


title: On Dirichlet eigenvalues of regular polygons

abstract: We prove that the first Dirichlet eigenvalue of a regular $N$-gon of area $\pi$ has an asymptotic expansion of the form $\lambda_1(1+\sum_{n\ge3}C_n(\lambda_1)N^{-n})$ as $N\to\infty$, where $\lambda_1$ is the first Dirichlet eigenvalue of the unit disk and $C_n$ are polynomials whose coefficients belong to the space of multiple zeta values of weight $n$. We also explicitly compute these polynomials for all $n\le14$.


title: Ants and bracket generating distributions in dimension 5 and 6

abstract: We consider a mechanical system of three ants on the floor, which move according to two independt rules: Rule A - forces the velocity of any given ant to always point at a neighboring ant, and Rule B - forces the velocity of every ant to be parallel to the line defined by the two other ants. We observe that Rule A equips the 6-dimensional configuration space of the ants with a structure of a homogeneous (3,6) distribution, and that Rule B foliates this 6-dimensional configuration space onto 5-dimensional leaves, each of which is equiped with a homogeneous (2,3,5) distribution. The symmetry properties and Bryant-Cartan local invariants of these distributions are determined. In the case of Rule B we study and determine the singular trajectories (abnormal extremals) of the corresponding distributions. We show that these satisfy an interesting system of two ODEs of Fuchsian type.


title: Comparing acoustic analyses of speech data collected remotely

abstract: Face-to-face speech data collection has been next to impossible globally due to COVID-19 restrictions. To address this problem, simultaneous recordings of three repetitions of the cardinal vowels were made using a Zoom H6 Handy Recorder with external microphone (henceforth H6) and compared with two alternatives accessible to potential participants at home: the Zoom meeting application (henceforth Zoom) and two lossless mobile phone applications (Awesome Voice Recorder, and Recorder; henceforth Phone). F0 was tracked accurately by all devices; however, for formant analysis (F1, F2, F3) Phone performed better than Zoom, i.e. more similarly to H6, though data extraction method (VoiceSauce, Praat) also resulted in differences. In addition, Zoom recordings exhibited unexpected drops in intensity. The results suggest that lossless format phone recordings present a viable option for at least some phonetic studies.


title: Multiscale change point detection via gradual bandwidth adjustment in moving sum processes

abstract: A method for the detection of changes in the expectation in univariate sequences is provided. Moving sum processes are studied. These rely on the selection of a tuning bandwidth. Here, a framework to overcome bandwidth selection is presented - the bandwidth adjusts gradually. For that, moving sum processes are made dependent on both time and the bandwidth: the domain becomes a triangle. On the triangle, paths are constructed which systematically lead to change points. An algorithm is provided that estimates change points by subsequent consideration of paths. Strong consistency for the number and location of change points is shown. Simulations support estimation precision. A companion R-package mscp is made available on CRAN.


title: A Hybrid Quantum-Classical Hamiltonian Learning Algorithm

abstract: Hamiltonian learning is crucial to the certification of quantum devices and quantum simulators. In this paper, we propose a hybrid quantum-classical Hamiltonian learning algorithm to find the coefficients of the Pauli operator components of the Hamiltonian. Its main subroutine is the practical log-partition function estimation algorithm, which is based on the minimization of the free energy of the system. Concretely, we devise a stochastic variational quantum eigensolver (SVQE) to diagonalize the Hamiltonians and then exploit the obtained eigenvalues to compute the free energy's global minimum using convex optimization. Our approach not only avoids the challenge of estimating von Neumann entropy in free energy minimization, but also reduces the quantum resources via importance sampling in Hamiltonian diagonalization, facilitating the implementation of our method on near-term quantum devices. Finally, we demonstrate our approach's validity by conducting numerical experiments with Hamiltonians of interest in quantum many-body physics.

categories: quant-ph cond-mat.stat-mech cs.LG hep-th


title: On the motion of gravity-capillary waves with odd viscosity

abstract: We develop three asymptotic models of surface waves in a non-newtonian fluid with odd viscosity. This viscosity is also known as Hall viscosity and appears in a number of applications such as quantum Hall fluids or chiral active fluids. Besides the odd viscosity effects, these models capture both gravity and capillary forces up to quadratic interactions and take the form of nonlinear and nonlocal wave equations. Two of these models describe bidirectional waves while the third PDE studies the case of unidirectional propagation. We also prove the well-posedness of these asymptotic models in spaces of analytic functions and in Sobolev spaces. Finally, we present a number of numerical simulations for the unidirectional model.


title: Joint Location and Communication Study for Intelligent Reflecting Surface Aided Wireless Communication System

abstract: Intelligent reflecting surface (IRS) is a novel burgeoning concept, which possesses advantages in enhancing wireless communication and user localization, while maintaining low hardware cost and energy consumption. Herein, we establish an IRS-aided mmWave-MIMO based joint localization and communication system (IMM-JLCS), and probe into its performance evaluation and optimization design. Specifically, first, we provide the signal, channel and estimation error models, and contrive the working process of the IMM-JLCS in detail. Then, by configuring appropriate IRS phase shifts, we derive the closed-form expressions of the Cramer-Rao Lower Bound (CRLB) of the position/orientation estimation errors and the effective achievable data rate (EADR), with respect to the time allocation ratio of the beam alignment and localization stage (BALS). Subsequently, we investigate the trade-off between the two performance metrics, for which we propose a joint optimization algorithm. Finally, we carry out simulations and comparisons to view the trade-off and validate the effectiveness of the proposed algorithm, in the presence of distinct levels of estimation uncertainty and user mobility. Our results demonstrate that the proposed algorithm can find the joint optimal solution for the position/orientation estimation accuracy and EADR, with its optimization performance being robust to slight localization or channel estimation errors and user mobility.


title: Probing dark exciton navigation through a local strain landscape in a WSe$_2$ monolayer

abstract: Monolayers of transition metal dichalcogenides (TMDs) have recently emerged as a promising optoelectronic platform. To leverage their full potential, however, it is important to understand and engineer the properties of the different exciton species that exist in these monolayers, as well as to control their transport through the material. A promising approach relies on engineering strain landscapes in atomically thin semiconductors that excitons navigate. In WSe$_2$ monolayers, for example, localized strain has been used to control the emission wavelength of excitons, induce exciton funneling and conversion, and even realize single-photon sources and quantum dots. Before these phenomena can be fully leveraged for applications, including quantum information processing, the details of excitons' interaction with the strain landscape must be well understood. To address this, we have developed a cryogenic technique capable of probing the dynamics of both bright and dark excitons in nanoscale strain landscapes in TMDs. In our approach, a nanosculpted tapered optical fiber is used to simultaneously generate strain and probe the near-field optical response of WSe$_2$ monolayers at 5 K. When the monolayer is pushed by the fiber, its lowest energy photoluminescence (PL) peaks red shift by as much as 390 meV, (corresponding to 20% of the bandgap of an unstrained WSe$_2$ monolayer). The red-shifting peaks are polarized perpendicularly to the WSe$_2$ plane and have long rising times (10 ps) and lifetimes (52 ps), indicating that they originate from nominally spin-forbidden dark excitons. Taken together, these observations indicate that dark excitons are funneled to the high-strain regions during their long lifetime and are the principal participants in drift and diffusion at cryogenic temperatures. Our work elucidates the important role that dark excitons play in locally strained WSe$_2$.


title: Adapting MARBERT for Improved Arabic Dialect Identification: Submission to the NADI 2021 Shared Task

abstract: In this paper, we tackle the Nuanced Arabic Dialect Identification (NADI) shared task (Abdul-Mageed et al., 2021) and demonstrate state-of-the-art results on all of its four subtasks. Tasks are to identify the geographic origin of short Dialectal (DA) and Modern Standard Arabic (MSA) utterances at the levels of both country and province. Our final model is an ensemble of variants built on top of MARBERT that achieves an F1-score of 34.03% for DA at the country-level development set -- an improvement of 7.63% from previous work.


title: Nerves and cones of free loop-free {\omega}-categories

abstract: We show that the complicial nerve construction is homotopically compatible with two flavors of cone constructions when starting with an $\omega$-category that is suitably free and loop-free. An instance of the result recovers the fact that the standard $m$-simplex is equivalent to the complicial nerve of the $m$-oriental.


title: Strong accessibility for hyperbolic groups

abstract: This paper aims to give an account of theorem of Louder and Touikan which shows that many hierarchies consisting of slender JSJ-decompositions are finite. In particular JSJ-hierarchies of $2$-torsion-free hyperbolic groups are always finite.


title: Bridgeland stability conditions and the tangent bundle of surfaces of general type

abstract: Let $X$ be a smooth compact complex surface with the canonical divisor $K_X$ ample and let $\Theta_X$ be its holomorphic tangent bundle. Bridgeland stability conditions are used to study the space $H^1 (\Theta_X)$ of infinitesimal deformations of complex structures of $X$ and its relation to the geometry/topology of $X$. The main observation is that for $X$ with $H^1 (\Theta_X)$ nonzero and the Chern numbers $(c_2 (X), K^2_X)$ subject to $$ \tau_X :=2ch_2 (\Theta_X)=K^2_X -2c_2(X) >0 $$ the object $\Theta_X [1]$ of the derived category of bounded complexes of coherent sheaves on $X$ is Bridgeland unstable in a certain part of the space of Bridgeland stability conditions. The Harder-Narasimhan filtrations of $\Theta_X [1]$ for those stability conditions are expected to provide new insights into geometry of surfaces of general type and the study of their moduli. The paper provides a certain body of evidence that this is indeed the case.


title: Multicanonical reweighting for the QCD topological susceptibility

abstract: We introduce a reweighting technique which allows for a continuous sampling of temperatures in a single simulation and employ it to compute the temperature dependence of the QCD topological susceptibility at high temperatures. The method determines the ratio of susceptibility between any two temperatures within the explored temperature range. We find that the results from the method agree with our previous determination and that it is competitive with but not better than existing methods of determining the temperature derivative of the susceptibility. The method may also be useful in exploring the temperature dependence of other thermodynamical observables in QCD in a continuous way.


title: Insights from the quantitative calibration of an elasto-plastic model from a Lennard-Jones atomic glass

abstract: We compare the macroscopic and the local plastic behavior of a model amorphous solid based on two radically different numerical descriptions. On the one hand, we simulate glass samples by atomistic simulations. On the other, we implement a mesoscale elasto-plastic model based on a solid-mechanics description. The latter is extended to consider the anisotropy of the yield surface via statistically distributed local and discrete weak planes on which shear transformations can be activated. To make the comparison as quantitative as possible, we consider the simple case of a quasistatically driven two-dimensional system in the stationary flow state and compare mechanical observables measured on both models over the same length scales. We show that the macroscale response, including its fluctuations, can be quantitatively recovered for a range of elasto-plastic mesoscale parameters. Using a newly developed method that makes it possible to probe the local yield stresses in atomistic simulations, we calibrate the local mechanical response of the elasto-plastic model at different coarse-graining scales. In this case, the calibration shows a qualitative agreement only for an optimized subset of mesoscale parameters and for sufficiently coarse probing length scales. This calibration allows us to establish a length scale for the mesoscopic elements that corresponds to an upper bound of the shear transformation size, a key physical parameter in elasto-plastic models. We find that certain properties naturally emerge from the elasto-plastic model. In particular, we show that the elasto-plastic model reproduces the Bauschinger effect, namely the plasticity-induced anisotropy in the stress-strain response. We discuss the successes and failures of our approach, the impact of different model ingredients and propose future research directions for quantitative multi-scale models of amorphous plasticity.


title: A survey on Variational Autoencoders from a GreenAI perspective

abstract: Variational AutoEncoders (VAEs) are powerful generative models that merge elements from statistics and information theory with the flexibility offered by deep neural networks to efficiently solve the generation problem for high dimensional data. The key insight of VAEs is to learn the latent distribution of data in such a way that new meaningful samples can be generated from it. This approach led to tremendous research and variations in the architectural design of VAEs, nourishing the recent field of research known as unsupervised representation learning. In this article, we provide a comparative evaluation of some of the most successful, recent variations of VAEs. We particularly focus the analysis on the energetic efficiency of the different models, in the spirit of the so called Green AI, aiming both to reduce the carbon footprint and the financial cost of generative techniques. For each architecture we provide its mathematical formulation, the ideas underlying its design, a detailed model description, a running implementation and quantitative results.


title: Efficient exploration and calibration of a semi-analytical model of galaxy formation with deep learning

abstract: We implement a sample-efficient method for rapid and accurate emulation of semi-analytical galaxy formation models over a wide range of model outputs. We use ensembled deep learning algorithms to produce a fast emulator of an updated version of the GALFORM model from a small number of training examples. We use the emulator to explore the model's parameter space, and apply sensitivity analysis techniques to better understand the relative importance of the model parameters. We uncover key tensions between observational datasets by applying a heuristic weighting scheme in a Markov chain Monte Carlo framework and exploring the effects of requiring improved fits to certain datasets relative to others. Furthermore, we demonstrate that this method can be used to successfully calibrate the model parameters to a comprehensive list of observational constraints. In doing so, we re-discover previous GALFORM fits in an automatic and transparent way, and discover an improved fit by applying a heavier weighting to the fit to the metallicities of early-type galaxies. The deep learning emulator requires a fraction of the model evaluations needed in similar emulation approaches, achieving an out-of-sample mean absolute error at the knee of the K-band luminosity function of 0.06 dex with less than 1000 model evaluations. We demonstrate that this is an extremely efficient, inexpensive and transparent way to explore multi-dimensional parameter spaces, and can be applied more widely beyond semi-analytical galaxy formation models.


title: Maximums of generalized Hasse-Witt invariants and their applications to anabelian geometry

abstract: Let $(X, D_{X})$ be an arbitrary pointed stable curve of topological type $(g_{X}, n_{X})$ over an algebraically closed field of characteristic $p>0$. We prove that the generalized Hasse-Witt invariants of prime-to-$p$ cyclic admissible coverings of $(X, D_{X})$ attain maximum. As applications, we obtain an anabelian formula for $(g_{X}, n_{X})$, and prove that the field structures associated to inertia subgroups of marked points can be reconstructed group-theoretically from open continuous homomorphisms of admissible fundamental groups. Moreover, the formula for maximum generalized Hasse-Witt invariants and the result concerning reconstructions of field structures play important roles in the theory of moduli spaces of fundamental groups developed by the author of the present paper.


title: Dimension Reduced Turbulent Flow Data From Deep Vector Quantizers

abstract: Analyzing large-scale data from simulations of turbulent flows is memory intensive, requiring significant resources. This major challenge highlights the need for data compression techniques. In this study, we apply a physics-informed Deep Learning technique based on vector quantization to generate a discrete, low-dimensional representation of data from simulations of three-dimensional turbulent flows. The deep learning framework is composed of convolutional layers and incorporates physical constraints on the flow, such as preserving incompressibility and global statistical characteristics of the velocity gradients. The accuracy of the model is assessed using statistical, comparison-based similarity and physics-based metrics. The training data set is produced from Direct Numerical Simulation of an incompressible, statistically stationary, isotropic turbulent flow. The performance of this lossy data compression scheme is evaluated not only with unseen data from the stationary, isotropic turbulent flow, but also with data from decaying isotropic turbulence, a Taylor-Green vortex flow, and a turbulent channel flow. Defining the compression ratio (CR) as the ratio of original data size to the compressed one, the results show that our model based on vector quantization can offer CR$=85$ with a mean square error (MSE) of $O(10^{-3})$, and predictions that faithfully reproduce the statistics of the flow, except at the very smallest scales where there is some loss. Compared to the recent study of Glaws. et. al. (Physical Review Fluids, 5(11):114602, 2020), which was based on a conventional autoencoder (where compression is performed in a continuous space), our model improves the CR by more than $30$ percent...


title: OmniNet: Omnidirectional Representations from Transformers

abstract: This paper proposes Omnidirectional Representations from Transformers (OmniNet). In OmniNet, instead of maintaining a strictly horizontal receptive field, each token is allowed to attend to all tokens in the entire network. This process can also be interpreted as a form of extreme or intensive attention mechanism that has the receptive field of the entire width and depth of the network. To this end, the omnidirectional attention is learned via a meta-learner, which is essentially another self-attention based model. In order to mitigate the computationally expensive costs of full receptive field attention, we leverage efficient self-attention models such as kernel-based (Choromanski et al.), low-rank attention (Wang et al.) and/or Big Bird (Zaheer et al.) as the meta-learner. Extensive experiments are conducted on autoregressive language modeling (LM1B, C4), Machine Translation, Long Range Arena (LRA), and Image Recognition. The experiments show that OmniNet achieves considerable improvements across these tasks, including achieving state-of-the-art performance on LM1B, WMT'14 En-De/En-Fr, and Long Range Arena. Moreover, using omnidirectional representation in Vision Transformers leads to significant improvements on image recognition tasks on both few-shot learning and fine-tuning setups.


title: Complex interferometry of magnetized plasma: accuracy and limitations

abstract: Expanding laser plasmas, produced by high energy laser radiation, possess both high thermal and magnetic field energy density. Characterization of such plasma is challenging but needed for understanding of its physical behaviour. Among all standard experimental techniques for plasma diagnostics, classical interferometry is one of the most convenient, informative and accurate. Attempts to extract more information from each single laser shot have led to development of complex interferometry, which under certain processing allows to reconstruct both plasma electron density and magnetic field strength distributions using just one data object. However, the increase in complexity and universality of the diagnostics requires a more detailed analysis of the extracted values and their accuracy.This work focuses on axisymmetric interaction geometry. We present general analysis, starting from the basic principles and trace main error sources, finally ending up with plasma density and magnetic field distributions with the derived error bars. Use of synthetic profiles makes the analysis universal, though we present an example with real experimental data in the Appendix.

categories: physics.plasm-ph physics.data-an physics.ins-det physics.optics


title: Universal-Prototype Enhancing for Few-Shot Object Detection

abstract: Few-shot object detection (FSOD) aims to strengthen the performance of novel object detection with few labeled samples. To alleviate the constraint of few samples, enhancing the generalization ability of learned features for novel objects plays a key role. Thus, the feature learning process of FSOD should focus more on intrinsical object characteristics, which are invariant under different visual changes and therefore are helpful for feature generalization. Unlike previous attempts of the meta-learning paradigm, in this paper, we explore how to enhance object features with intrinsical characteristics that are universal across different object categories. We propose a new prototype, namely universal prototype, that is learned from all object categories. Besides the advantage of characterizing invariant characteristics, the universal prototypes alleviate the impact of unbalanced object categories. After enhancing object features with the universal prototypes, we impose a consistency loss to maximize the agreement between the enhanced features and the original ones, which is beneficial for learning invariant object characteristics. Thus, we develop a new framework of few-shot object detection with universal prototypes ({FSOD}^{up}) that owns the merit of feature generalization towards novel objects. Experimental results on PASCAL VOC and MS COCO show the effectiveness of {FSOD}^{up}. Particularly, for the 1-shot case of VOC Split2, {FSOD}^{up} outperforms the baseline by 6.8% in terms of mAP.


title: Um Estudo sobre Atividades Participativas para Solu\c{c}\~oes IoT para o Home care de Pessoas Idosas

abstract: Population aging in Brazil and in the world occurs at the same time of advances and evolutions in technology. Thus, opportunities for new solutions arise for the elderly, such as innovations in Home Care. With the Internet of Things, it is possible to improve the elderly autonomy, safety and quality of life. However, the design of IoT solutions for elderly Home Care poses new challenges. In this context, this technical report aims to detail activities developed as a case study to evaluate the IoT-PMHCS Method, which was developed in the context of the Master's program in Computer Science at UNIFACCAMP, Brazil. This report includes the planning and results of interviews, participatory workshops, validations, simulation of solutions, among other activities. This document reports the practical experience of applying the IoT-PMHCS Method. -- O envelhecimento populacional no Brasil e no mundo ocorre ao mesmo tempo que os avan\c{c}os e evolu\c{c}\~oes na tecnologia. Desta forma, surgem oportunidades de novas solu\c{c}\~oes para o p\'ublico idoso, tais como inova\c{c}\~oes em Home Care. Com a Internet das Coisas \'e poss\'ivel promover maior autonomia, seguran\c{c}a e qualidade de vida aos idosos. Entretanto, o design de solu\c{c}\~oes de IoT para Home Care de pessoas idosas traz novos desafios. Diante disto, este relat\'orio t\'ecnico tem o objetivo de detalhar atividades desenvolvidas como estudo de caso para avalia\c{c}\~ao do M\'etodo IoT-PMHCS, desenvolvido no contexto do programa de Mestrado em Ci\^encia da Computa\c{c}\~ao da UNIFACCAMP, Brasil. O relat\'orio inclui o planejamento e resultados de entrevistas, workshops participativos, pesquisas de valida\c{c}\~ao, simula\c{c}\~ao de solu\c{c}\~oes, dentre outras atividades. Este documento relata a experi\^encia pr\'atica da aplica\c{c}\~ao do M\'etodo IoT-PMHCS.


title: Transition distribution amplitudes and hard exclusive reactions with baryon number transfer

abstract: Baryon-to-meson and baryon-to-photon transition distribution amplitudes (TDAs) arise in the collinear factorized description of a class of hard exclusive reactions characterized by the exchange of a non-zero baryon number in the cross channel. These TDAs extend the concepts of generalized parton distributions (GPDs) and baryon distribution amplitudes (DAs). In this review, we discuss the general properties and physical interpretation of baryon-to-meson and baryon-to-photon TDAs. We argue that these non-perturbative objects are a convenient complementary tool to explore the structure of baryons at the partonic level. We present an overview of hard exclusive reactions admitting a description in terms of TDAs. We discuss the first signals from hard exclusive backward meson electroproduction at JLab with the 6 GeV electron beam and explore further experimental opportunities to access TDAs at JLab@12 GeV, PANDA, J-PARC and EIC.


title: Observables in Quantum Mechanics and the Importance of Self-adjointness

abstract: We are focused on the idea that observables in quantum physics are a bit more than just hermitian operators and that this is, in general, a "tricky business". The origin of this idea comes from the fact that there is a subtle difference between symmetric, hermitian, and self-adjoint operators which are of immense importance in formulating Quantum Mechanics. The theory of self-adjoint extensions is presented through several physical examples and some emphasis is given on the physical implications and applications.


title: Drinfel'd doubles of the $n$-rank Taft algebras and a generalization of the Jones polynomial

abstract: In the paper, we describe the Drinfel'd double structure of the $n$-rank Taft algebra and all of its simple modules, and then endow its $R$-matrices with some application to knot invariants. The knot invariants we get is a generalization of the Jones polynomial, in particular, it recovers the Jones polynomial in rank $1$ case, while in rank $2$ case, it is the one-parameter specialization of the two-parameter unframed Dubrovnik polynomial, and in higher rank case it is the composite ($n$-power) of the Jones polynomial.


title: MD Simulations of Charged Binary Mixtures Reveal a Generic Relation Between High- and Low-Temperature Behavior

abstract: Experimental studies of the glassy slowdown in molecular liquids indicate that the high-temperature activation energy $E_{\infty}$ of glass-forming liquids is directly related to their glass transition temperature $T_{\text{g}}$. To further investigate such a possible relation between high- and low-temperature dynamics in glass-forming liquids, we analyze the glassy dynamics of binary mixtures using molecular dynamics (MD) simulations. We consider a binary mixture of charged Lennard-Jones particles and vary the partial charges of the particles, and thus, the high-temperature activation energy and the glass transition temperature of the system. Based on previous results, we introduce a phenomenological model describing relaxation times over the whole temperature regime from high temperatures to temperatures well inside the supercooled regime. By investigating the dynamics of both particle species on molecular and diffusive length scales along isochoric and isobaric pathways, we find a quadratic charge dependence of both $E_{\infty}$ and $T_{\text{g}}$, resulting in an approximately constant ratio of both quantities independent of the underlying observable, the thermodynamic ensemble, and the particle species, and this result is robust against the actual definition of $T_{\text{g}}$. This generic relation between the activation energy and the glass transition temperature indicates that high-temperature dynamics and the glassy slowdown are related phenomena, and the knowledge of $E_{\infty}$ may allow to approximately predict $T_{\text{g}}$.


title: Local discontinuous Galerkin method on layer-adapted meshes for singularly perturbed reaction-diffusion problems in two dimensions

abstract: We analyse the local discontinuous Galerkin (LDG) method for two-dimensional singularly perturbed reaction-diffusion problems. A class of layer-adapted meshes, including Shishkin- and Bakhvalov-type meshes, is discussed within a general framework. Local projections and their approximation properties on anisotropic meshes are used to derive error estimates for energy and "balanced" norms. Here, the energy norm is naturally derived from the bilinear form of LDG formulation and the "balanced" norm is artifically introduced to capture the boundary layer contribution. We establish a uniform convergence of order $k$ for the LDG method using the balanced norm with the local weighted $L^2$ projection as well as an optimal convergence of order $k+1$ for the energy norm using the local Gauss-Radau projections. Numerical experiments are presented.


title: A Simple Algorithm for Optimal Search Trees with Two-Way Comparisons

abstract: We present a simple $O(n^4)$-time algorithm for computing optimal search trees with two-way comparisons. The only previous solution to this problem, by Anderson et al., has the same running time, but is significantly more complicated and is restricted to the variant where only successful queries are allowed. Our algorithm extends directly to solve the standard full variant of the problem, which also allows unsuccessful queries and for which no polynomial-time algorithm was previously known. The correctness proof of our algorithm relies on a new structural theorem for two-way-comparison search trees.


title: Challenges and Opportunities in High-dimensional Variational Inference

abstract: Current black-box variational inference (BBVI) methods require the user to make numerous design choices -- such as the selection of variational objective and approximating family -- yet there is little principled guidance on how to do so. We develop a conceptual framework and set of experimental tools to understand the effects of these choices, which we leverage to propose best practices for maximizing posterior approximation accuracy. Our approach is based on studying the pre-asymptotic tail behavior of the density ratios between the joint distribution and the variational approximation, then exploiting insights and tools from the importance sampling literature. Our framework and supporting experiments help to distinguish between the behavior of BBVI methods for approximating low-dimensional versus moderate-to-high-dimensional posteriors. In the latter case, we show that mass-covering variational objectives are difficult to optimize and do not improve accuracy, but flexible variational families can improve accuracy and the effectiveness of importance sampling -- at the cost of additional optimization challenges. Therefore, for moderate-to-high-dimensional posteriors we recommend using the (mode-seeking) exclusive KL divergence since it is the easiest to optimize, and improving the variational family or using model parameter transformations to make the posterior and optimal variational approximation more similar. On the other hand, in low-dimensional settings, we show that heavy-tailed variational families and mass-covering divergences are effective and can increase the chances that the approximation can be improved by importance sampling.


title: Surface detectors of the TAx4 experiment

abstract: Telescope Array (TA) is the largest ultrahigh energy cosmic-ray (UHECR) observatory in the Northern Hemisphere. It explores the origin of UHECRs by measuring their energy spectrum, arrival-direction distribution, and mass composition using a surface detector (SD) array covering approximately 700 km$^2$ and fluorescence detector (FD) stations. TA has found evidence for a cluster of cosmic rays with energies greater than 57 EeV. In order to confirm this evidence with more data, it is necessary to increase the data collection rate.We have begun building an expansion of TA that we call TAx4. In this paper, we explain the motivation, design, technical features, and expected performance of the TAx4 SD. We also present TAx4's current status and examples of the data that have already been collected.


title: Stochastic Model Predictive Control for tracking of distributed linear systems with additive uncertainty

abstract: In this paper, we propose a chance constrained stochastic model predictive control scheme for reference tracking of distributed linear time-invariant systems with additive stochastic uncertainty. The chance constraints are reformulated analytically based on mean-variance information, where we design suitable Probabilistic Reachable Sets for constraint tightening. Furthermore, the chance constraints are proven to be satisfied in closed-loop operation. The design of an invariant set for tracking complements the controller and ensures convergence to arbitrary admissible reference points, while a conditional initialization scheme provides the fundamental property of recursive feasibility. The paper closes with a numerical example, highlighting the convergence to changing output references and empirical constraint satisfaction.


title: Code smells: A Synthetic Narrative Review

abstract: Code smells are symptoms of poor design and implementation choices, which might hinder comprehension, increase code complexity and fault-proneness and decrease maintainability of software systems. The aim of our study was to perform a triangulation of bibliometric and thematic analysis on code smell literature production. The search was performed on Scopus (Elsevier, Netherlands) database using the search string code smells which resulted in 442 publications. The Go-to statement was the first bad code smells identified in software engineering history in 1968. The literature production trend has been positive. The most productive countries were the United States, Italy and Brazil. Eight research themes were identified: Managing software maintenance, Smell detection-based software refactoring, Architectural smells, Improving software quality with multi-objective approaches, Technical debt and its instance, Quality improvement/assurance with mining software repositories, Programming education, Integrating the concepts of anti-pattern, design defects and design smells. Some research gaps also emerged, namely, New uncatalogued smell identification; Smell propagation from architectural, design, code to test, and other possible smells; and Identification of good smells. The results of our study can help code smell researchers and practitioners understand the broader aspects of code smells research and its translation to practice.


title: A Biased Graph Neural Network Sampler with Near-Optimal Regret

abstract: Graph neural networks (GNN) have recently emerged as a vehicle for applying deep network architectures to graph and relational data. However, given the increasing size of industrial datasets, in many practical situations the message passing computations required for sharing information across GNN layers are no longer scalable. Although various sampling methods have been introduced to approximate full-graph training within a tractable budget, there remain unresolved complications such as high variances and limited theoretical guarantees. To address these issues, we build upon existing work and treat GNN neighbor sampling as a multi-armed bandit problem but with a newly-designed reward function that introduces some degree of bias designed to reduce variance and avoid unstable, possibly-unbounded pay outs. And unlike prior bandit-GNN use cases, the resulting policy leads to near-optimal regret while accounting for the GNN training dynamics introduced by SGD. From a practical standpoint, this translates into lower variance estimates and competitive or superior test accuracy across several benchmarks.


title: Systematic Analysis and Removal of Circular Artifacts for StyleGAN

abstract: StyleGAN is one of the state-of-the-art image generators which is well-known for synthesizing high-resolution and hyper-realistic face images. Though images generated by vanilla StyleGAN model are visually appealing, they sometimes contain prominent circular artifacts which severely degrade the quality of generated images. In this work, we provide a systematic investigation on how those circular artifacts are formed by studying the functionalities of different stages of vanilla StyleGAN architecture, with both mechanism analysis and extensive experiments. The key modules of vanilla StyleGAN that promote such undesired artifacts are highlighted. Our investigation also explains why the artifacts are usually circular, relatively small and rarely split into 2 or more parts. Besides, we propose a simple yet effective solution to remove the prominent circular artifacts for vanilla StyleGAN, by applying a novel pixel-instance normalization (PIN) layer.


title: Trilevel Scheduling Model Considering Residential Demand Flexibility of Aggregated HVACs and EVs under Distribution LMP

abstract: Residential loads, especially heating, ventilation, and air conditioners (HVACs) and electric vehicles (EVs) have great potentials to provide demand flexibility which is an attribute of Grid-interactive Efficient Buildings (GEB). Under this new paradigm, first, EV and HVAC aggregator models are developed in this paper to represent the fleet of GEBs, in which the aggregated parameters are obtained based on a new approach of data generation and least-squares parameter estimation (DG-LSPE), which can deal with heterogenous HVACs. Then, a tri-level bidding and dispatching framework is established based on competitive distribution operation with distribution locational marginal price (DLMP). The first two levels form a bilevel model to optimize the aggregators payment and to represent the interdependency between load aggregators and the distribution system operator (DSO) using DLMP, while the third level is to dispatch the optimal load aggregation to all residents by the proposed priority list-based demand dispatching algorithm. Finally, case studies on a modified IEEE 33-Bus system illustrate three main technical reasons for payment reduction due to demand flexibility: load shift, DLMP step changes, and power losses. They can be used as general guidelines for better decision-making for future planning and operation of demand response programs.


title: A new amplitude-frequency formula for non-conservative oscillators

abstract: This paper formalize the existence's proof of first-integrals for any second order ODE, allowing to discriminate periodic orbits. Up to the author's knowledge, such a powerful result is not available in the literature providing a tool to determine periodic orbits/limit cycles in the most general scenario.


title: Quantifying Indirect Gender Discrimination on Collaborative Platforms

abstract: Digital collaborative platforms have become crucial venues of career advancement and individual success in many creative fields, from engineering to the arts. Indirect gender discrimination is a key component to gendered disadvantage on platforms. Such platforms carried the promise of opening avenues of advancement to previously discriminated groups, such as women, as platforms lack managerial gatekeepers with conventional prejudice. We analyzed the extent of indirect gender discriminatory on two diverse platforms, GitHub and Behance, focused on software development and fine arts and design. We found that the main cause of women's disadvantage in attention, success, and survival is largely due to indirect discrimination that varies between 60-90\% of total female disadvantage. Men and women are penalized if they follow highly female-like behavior, while categorical gender's impact varies by outcome and field. As platforms employ algorithmic tools and AI systems to manage users' activity, visibility and recommend new projects to collaborate, stereotypes rooted in behavior can have long-lasting consequences.


title: Tornado waves

abstract: We show that light spiraling like a tornado can be generated by superimposing abruptly auto-focusing ring-Airy beams that carry orbital angular momentum of opposite handedness. With different parabolic propagation trajectories, the superimposing ring-Airy beams are tailored to abruptly auto-focus at overlapping focal regions. This results to a complex wave with intense lobes that twist and shrink in an accelerating fashion along propagation. By achieving angular acceleration values that exceed 295 rad\mm^2, these Tornado waves can find numerous applications in laser trapping, direct laser writing and high harmonic generation.


title: Software Development with Scrum: A Bibliometric Analysis and Profile

abstract: Introduction of the Scrum approach into software engineering has changed the way software is being developed. The Scrum approach emphasizes the active end-user involvement, embracing of change, and /iterative delivery of products. Our study showed that Scrum has different variants or is used in combination with different methods. Some tools not normally used in the conventional software approaches, like gamification, content analysis and grounded theory are also employed. However, Scrum like other software development approach focuses on improvement of software process, software quality, business value, performance, usability and efficiency and at the same time to reduce cost, risk and uncertainty. Contrary to some conventional approaches it also strives to boost soft factors like agility, trust, motivation, responsibility and transparency. The bibliometric synthetic scoping study revealed seven main research themes concerned with the Scrum research.


title: Counterfactual Explanations for Oblique Decision Trees: Exact, Efficient Algorithms

abstract: We consider counterfactual explanations, the problem of minimally adjusting features in a source input instance so that it is classified as a target class under a given classifier. This has become a topic of recent interest as a way to query a trained model and suggest possible actions to overturn its decision. Mathematically, the problem is formally equivalent to that of finding adversarial examples, which also has attracted significant attention recently. Most work on either counterfactual explanations or adversarial examples has focused on differentiable classifiers, such as neural nets. We focus on classification trees, both axis-aligned and oblique (having hyperplane splits). Although here the counterfactual optimization problem is nonconvex and nondifferentiable, we show that an exact solution can be computed very efficiently, even with high-dimensional feature vectors and with both continuous and categorical features, and demonstrate it in different datasets and settings. The results are particularly relevant for finance, medicine or legal applications, where interpretability and counterfactual explanations are particularly important.


title: Tangent functional canonical correlation analysis for densities and shapes, with applications to multimodal imaging data

abstract: It is quite common for functional data arising from imaging data to assume values in infinite-dimensional manifolds. Uncovering associations between two or more such nonlinear functional data extracted from the same object across medical imaging modalities can assist development of personalized treatment strategies. We propose a method for canonical correlation analysis between paired probability densities or shapes of closed planar curves, routinely used in biomedical studies, which combines a convenient linearization and dimension reduction of the data using tangent space coordinates. Leveraging the fact that the corresponding manifolds are submanifolds of unit Hilbert spheres, we describe how finite-dimensional representations of the functional data objects can be easily computed, which then facilitates use of standard multivariate canonical correlation analysis methods. We further construct and visualize canonical variate directions directly on the space of densities or shapes. Utility of the method is demonstrated through numerical simulations and performance on a magnetic resonance imaging dataset of Glioblastoma Multiforme brain tumors.


title: A Noachian proglacial paleolake on Mars: Fluvial activity and lake formation within a closed-source drainage basin crater and implications for early Mars climate

abstract: A 54-km diameter Noachian-aged crater in the southern highlands of Mars contains unusually well-preserved inverted fluvial channel networks and lacustrine deposits, all of which formed completely inside the crater. This closed-source drainage basin (CSDB) crater is distinct from previously documented fluvially breached or groundwater-fed crater basin lakes on Mars. We compare our observations to previously established models of crater degradation, fluvial incision, and topographic inversion on Mars to assess the most likely origins of the water that formed the fluvial and lacustrine features. We favor top-down melting of a cold-based glacier as the source of water in the CSDB crater, which would represent the first examples of proglacial fluvial channels and lakes found on Noachian Mars.


title: Enhancing the role of academic librarians in conducting scoping reviews

abstract: Information exposing, in conjunction with technological innovations and the emergence of social media, altered the traditional roles of academic libraries and enabled librarians to become necessary partners in research. The role of academic librarians in conducting systematic reviews is well recognised, however, their role in conducting scoping reviews is not yet well established. Nevertheless, we propose that, in more and more frequent situations when it is not feasible to read and analyse all relevant literature to be scoped manually, librarians employ bibliometric analysis and mapping to visualise and chart literature content. Our study demonstrated that science landscapes induced automatically by bibliometric mapping software could serve as a tool to visualise and chart the content of relevant literature when conducting the fourth step of scoping reviews. Additionaly science landscapes can help also serve to help improve the decision strategies when conducting scoping reviews. Keywords: Scoping


title: Categorical Depth Distribution Network for Monocular 3D Object Detection

abstract: Monocular 3D object detection is a key problem for autonomous vehicles, as it provides a solution with simple configuration compared to typical multi-sensor systems. The main challenge in monocular 3D detection lies in accurately predicting object depth, which must be inferred from object and scene cues due to the lack of direct range measurement. Many methods attempt to directly estimate depth to assist in 3D detection, but show limited performance as a result of depth inaccuracy. Our proposed solution, Categorical Depth Distribution Network (CaDDN), uses a predicted categorical depth distribution for each pixel to project rich contextual feature information to the appropriate depth interval in 3D space. We then use the computationally efficient bird's-eye-view projection and single-stage detector to produce the final output bounding boxes. We design CaDDN as a fully differentiable end-to-end approach for joint depth estimation and object detection. We validate our approach on the KITTI 3D object detection benchmark, where we rank 1st among published monocular methods. We also provide the first monocular 3D detection results on the newly released Waymo Open Dataset. We provide a code release for CaDDN which is made available.


title: Fermionization of conformal boundary states

abstract: We construct the complete set of boundary states of two-dimensional fermionic CFTs using that of the bosonic counterpart. We see that there are two groups of boundary conditions, which contributes to the open-string partition function by characters with integer coefficients, or with $\sqrt{2}$ times integer coefficients. We argue that, using the argument of [JHEP 09 (2020) 018], this $\sqrt{2}$ indicates a single unpaired Majorana zero mode, and that these two groups of boundary conditions are mutually incompatible. We end the paper by mentioning a possible interpretation of the result in terms of the entanglement entropy.


title: Delay differential equations for the spatially-resolved simulation of epidemics with specific application to COVID-19

abstract: In the wake of the 2020 COVID-19 epidemic, much work has been performed on the development of mathematical models for the simulation of the epidemic, and of disease models generally. Most works follow the susceptible-infected-removed (SIR) compartmental framework, modeling the epidemic with a system of ordinary differential equations. Alternative formulations using a partial differential equation (PDE) to incorporate both spatial and temporal resolution have also been introduced, with their numerical results showing potentially powerful descriptive and predictive capacity. In the present work, we introduce a new variation to such models by using delay differential equations (DDEs). The dynamics of many infectious diseases, including COVID-19, exhibit delays due to incubation periods and related phenomena. Accordingly, DDE models allow for a natural representation of the problem dynamics, in addition to offering advantages in terms of computational time and modeling, as they eliminate the need for additional, difficult-to-estimate, compartments (such as exposed individuals) to incorporate time delays. Here, we introduce a DDE epidemic model in both an ordinary- and partial differential equation framework. We present a series of mathematical results assessing the stability of the formulation. We then perform several numerical experiments, validating both the mathematical results and establishing model's ability to reproduce measured data on realistic problems.


title: Challenges for Machine Learning Force Fields in Reproducing Potential Energy Surfaces of Flexible Molecules

abstract: Dynamics of flexible molecules are often determined by an interplay between local chemical bond fluctuations and conformational changes driven by long-range electrostatics and van der Waals interactions. This interplay between interactions yields complex potential-energy surfaces (PES) with multiple minima and transition paths between them. In this work, we assess the performance of state-of-the-art Machine Learning (ML) models, namely sGDML, SchNet, GAP/SOAP, and BPNN for reproducing such PES, while using limited amounts of reference data. As a benchmark, we use the cis to trans thermal relaxation in an azobenzene molecule, where at least three different transition mechanisms should be considered. Although GAP/SOAP, SchNet, and sGDML models can globally achieve chemical accuracy of 1 kcal mol-1 with fewer than 1000 training points, predictions greatly depend on the ML method used as well as the local region of the PES being sampled. Within a given ML method, large differences can be found between predictions of close-to-equilibrium and transition regions, as well as for different transition mechanisms. We identify key challenges that the ML models face in learning long-range interactions and the intrinsic limitations of commonly used atom-based descriptors. All in all, our results suggest switching from learning the entire PES within a single model to using multiple local models with optimized descriptors, training sets, and architectures for different parts of complex PES.


title: Contact-Implicit Trajectory Optimization for Dynamic Object Manipulation

abstract: We present a reformulation of a contact-implicit optimization (CIO) approach that computes optimal trajectories for rigid-body systems in contact-rich settings. A hard-contact model is assumed, and the unilateral constraints are imposed in the form of complementarity conditions. Newton's impact law is adopted for enhanced physical correctness. The optimal control problem is formulated as a multi-staged program through a multiple-shooting scheme. This problem structure is exploited within the FORCES Pro framework to retrieve optimal motion plans, contact sequences and control inputs with increased computational efficiency. We investigate our method on a variety of dynamic object manipulation tasks, performed by a six degrees of freedom robot. The dynamic feasibility of the optimal trajectories, as well as the repeatability and accuracy of the task-satisfaction are verified through simulations and real hardware experiments on one of the manipulation problems.


title: Boundary from bulk integrability in three dimensions: 3D reflection maps from tetrahedron maps

abstract: We established a method for obtaining set-theoretical solutions to the 3D reflection equation by using known ones to the Zamolodchikov tetrahedron equation, where the former equation was proposed by Isaev and Kulish as a boundary analog of the latter. By applying our method to Sergeev's electrical solution and a two-component solution associated with the discrete modified KP equation, we obtain new solutions to the 3D reflection equation. Our approach is closely related to a relation between the transition maps of Lusztig's parametrizations of the totally positive part of $SL_3$ and $SO_5$, which is obtained via folding the Dynkin diagram of $A_3$ into one of $B_2$.


title: Anomalies in $b\to s \ell\ell$ transitions and Global Fits

abstract: We review the status of the anomalies in $b\to s \ell\ell$ transitions, and comment on the impact of the most recent measurements in 2019 and 2020 on the global fits. We also discuss a few developments in the theory calculation of local and non-local form factors.


title: Phase slips, dislocations, half-integer vortices, two-fluid hydrodynamics and the chiral anomaly in charge and spin density waves

abstract: This brief review recalls some chapters in theory of sliding incommensurate density waves which may have appeared after inspirations from studies of I.E Dzyaloshinskii and collaborations with him. First we address the spin density waves which rich order parameter allows for an unusual object of a complex topological nature: a half-integer dislocation combined with a semi-vortex of the staggered magnetization. It becomes energetically preferable with respect to an ordinary dislocation due to the high Coulomb energy at low concentration of carriers. Generation of these objects should form a sequence of pi-phase slips in accordance with experimental doubling of phase-slips rate. Next, we revise the commonly employed TDGL approach which is shown to suffer from a violation of the charge conservation law resulting in nonphysical generation of particles which is particularly pronounced for electronic vortices in the course of their nucleation or motion. The suggested consistent theory exploits the chiral transformations taking into account the principle contribution of the fermionic chiral anomaly to the effective action. The derived equations clarify partitions of charges,currents and rigidity among subsystems of the condensate and normal carriers and the gluing electric field. Being non-analytical with respect to the order parameter, contrarily the conventional TDGL type, the resulting equations still allow for a numerical modeling of transient processes related to space- and spatio-temporal vorticity in DWs.


title: Measuring Inconsistency over Sequences of Business Rule Cases

abstract: In this report, we investigate (element-based) inconsistency measures for multisets of business rule bases. Currently, related works allow to assess individual rule bases, however, as companies might encounter thousands of such instances daily, studying not only individual rule bases separately, but rather also their interrelations becomes necessary, especially in regard to determining suitable re-modelling strategies. We therefore present an approach to induce multiset-measures from arbitrary (traditional) inconsistency measures, propose new rationality postulates for a multiset use-case, and investigate the complexity of various aspects regarding multi-rule base inconsistency measurement.


title: Optimal Linear Combination of Classifiers

abstract: The question of whether to use one classifier or a combination of classifiers is a central topic in Machine Learning. We propose here a method for finding an optimal linear combination of classifiers derived from a bias-variance framework for the classification task.


title: Single-photon quantum hardware: towards scalable photonic quantum technology with a quantum advantage

abstract: The scaling up of quantum hardware is the fundamental challenge ahead in order to realize the disruptive potential of quantum technology in information science. Among the plethora of hardware platforms, photonics stands out by offering a modular approach, where the main challenge is to construct sufficiently high-quality building blocks and develop methods to efficiently interface them. Importantly, the subsequent scaling-up will make full use of the mature integrated photonic technology provided by photonic foundry infrastructure to produce small foot-print quantum processors of immense complexity. A fully coherent and deterministic photon-emitter interface is a key enabler of quantum photonics, and can today be realized with solid-state quantum emitters with specifications reaching the quantitative benchmark referred to as Quantum Advantage. This light-matter interaction primer realizes a range of quantum photonic resources and functionalities, including on-demand single-photon and multi-photon entanglement sources, and photon-photon nonlinear quantum gates. We will present the current state-of-the-art in single-photon quantum hardware and the main photonic building blocks required in order to scale up. Furthermore, we will point out specific promising applications of the hardware building blocks within quantum communication and photonic quantum computing, laying out the road ahead for quantum photonics applications that could offer a genuine quantum advantage.


title: On the Ordering of Sites in the Density Matrix Renormalization Group using Quantum Mutual Information

abstract: The density matrix renormalization group (DMRG) of White 1992 remains to this day an integral component of many state-of-the-art methods for efficiently simulating strongly correlated quantum systems. In quantum chemistry, QC-DMRG became a powerful tool for ab initio calculations with the non-relativistic Schr\"odinger equation. An important issue in QC-DMRG is the so-called ordering problem -- the optimal ordering of DMRG sites corresponding to electronic orbitals that produces the most accurate results. To this end, a commonly used heuristic is the grouping of strongly correlated orbitals as measured via quantum mutual information. In this work, we show how such heuristics can be directly related to minimizing the entanglement entropy of matrix product states and, consequently, to the truncation error of a fixed bond dimension approximation. Key to establishing this link is the strong subadditivity of entropy. This provides rigorous theoretical justification for the orbital ordering methods and suggests alternate ordering criteria.


title: Transverse K\"ahler holonomy in Sasaki Geometry and ${\oldmathcal S}$-Stability

abstract: We study the transverse K\"ahler holonomy groups on Sasaki manifolds $(M,{\oldmathcal S})$ and their stability properties under transverse holomorphic deformations of the characteristic foliation by the Reeb vector field. In particular, we prove that when the first Betti number $b_1(M)$ and the basic Hodge number $h^{0,2}_B({\oldmathcal S})$ vanish, then ${\oldmathcal S}$ is stable under deformations of the transverse K\"ahler flow. In addition we show that an irreducible transverse hyperk\"ahler Sasakian structure is ${\oldmathcal S}$-unstable, whereas, an irreducible transverse Calabi-Yau Sasakian structure is ${\oldmathcal S}$-stable when $\dim M\geq 7$. Finally, we prove that the standard Sasaki join operation (transverse holonomy $U(n_1)\times U(n_2)$) as well as the fiber join operation preserve ${\oldmathcal S}$-stability.


title: BV right continuous solutions of differential inclusions involving time dependent maximal monotone operators

abstract: This paper is devoted to the study of evolution problems involving time dependent maximal monotone operators, which are right continuous and bounded in variation with respect to the Vladimirov's pseudo distance. Several variants and applications are presented.


title: Deep Perceptual Image Quality Assessment for Compression

abstract: Lossy Image compression is necessary for efficient storage and transfer of data. Typically the trade-off between bit-rate and quality determines the optimal compression level. This makes the image quality metric an integral part of any imaging system. While the existing full-reference metrics such as PSNR and SSIM may be less sensitive to perceptual quality, the recently introduced learning methods may fail to generalize to unseen data. In this paper we propose the largest image compression quality dataset to date with human perceptual preferences, enabling the use of deep learning, and we develop a full reference perceptual quality assessment metric for lossy image compression that outperforms the existing state-of-the-art methods. We show that the proposed model can effectively learn from thousands of examples available in the new dataset, and consequently it generalizes better to other unseen datasets of human perceptual preference.


title: Structural models for policy-making: Coping with parametric uncertainty

abstract: The ex-ante evaluation of policies using structural econometric models is based on estimated parameters as a stand-in for the true parameters. This practice ignores uncertainty in the counterfactual policy predictions of the model. We develop a generic approach that deals with parametric uncertainty using uncertainty sets and frames model-informed policy-making as a decision problem under uncertainty. The seminal human capital investment model by Keane and Wolpin (1997) provides a well-known, influential, and empirically-grounded test case. We document considerable uncertainty in the models's policy predictions and highlight the resulting policy recommendations obtained from using different formal rules of decision-making under uncertainty.


title: Blockchain-Based Federated Learning in Mobile Edge Networks with Application in Internet of Vehicles

abstract: The rapid increase of the data scale in Internet of Vehicles (IoV) system paradigm, hews out new possibilities in boosting the service quality for the emerging applications through data sharing. Nevertheless, privacy concerns are major bottlenecks for data providers to share private data in traditional IoV networks. To this end, federated learning (FL) as an emerging learning paradigm, where data providers only send local model updates trained on their local raw data rather than upload any raw data, has been recently proposed to build a privacy-preserving data sharing models. Unfortunately, by analyzing on the differences of uploaded local model updates from data providers, private information can still be divulged, and performance of the system cannot be guaranteed when partial federated nodes executes malicious behavior. Additionally, traditional cloud-based FL poses challenges to the communication overhead with the rapid increase of terminal equipment in IoV system. All these issues inspire us to propose an autonomous blockchain empowered privacy-preserving FL framework in this paper, where the mobile edge computing (MEC) technology was naturally integrated in IoV system.


title: Directional emission from WS2 monolayer coupled to plasmonic Nanowire-on-Mirror Cavity

abstract: Influencing spectral and directional features of exciton emission characteristics from 2D transition metal dichalcogenides by coupling it to plasmonic nano-cavities has emerged as an important prospect in nanophotonics of 2D materials. In this paper we experimentally study the directional photoluminescence emission from Tungsten disulfide (WS2) monolayer sandwiched between a single-crystalline plasmonic silver nanowire (AgNW) waveguide and a gold (Au) mirror, thus forming an AgNW-WS2-Au cavity. By employing polarization-resolved Fourier plane optical microscopy, we quantify the directional emission characteristics from the distal end of the AgNW-WS2-Au cavity. Given that our geometry simultaneously facilitates local field enhancement and waveguiding capability, we envisage its utility in 2D material-based, on-chip nanophotonic signal processing, including nonlinear and quantum optical regimes.

categories: physics.optics cond-mat.mes-hall cond-mat.soft physics.app-ph


title: Deep Learning with a Classifier System: Initial Results

abstract: This article presents the first results from using a learning classifier system capable of performing adaptive computation with deep neural networks. Individual classifiers within the population are composed of two neural networks. The first acts as a gating or guarding component, which enables the conditional computation of an associated deep neural network on a per instance basis. Self-adaptive mutation is applied upon reproduction and prediction networks are refined with stochastic gradient descent during lifetime learning. The use of fully-connected and convolutional layers are evaluated on handwritten digit recognition tasks where evolution adapts (i) the gradient descent learning rate applied to each layer (ii) the number of units within each layer, i.e., the number of fully-connected neurons and the number of convolutional kernel filters (iii) the connectivity of each layer, i.e., whether each weight is active (iv) the weight magnitudes, enabling escape from local optima. The system automatically reduces the number of weights and units while maintaining performance after achieving a maximum prediction error.