title: Facilitate the Parametric Dimension Reduction by Gradient Clipping

abstract: We extend a well-known dimension reduction method, t-distributed stochastic neighbor embedding (t-SNE), from non-parametric to parametric by training neural networks. The main advantage of a parametric technique is the generalization of handling new data, which is particularly beneficial for streaming data exploration. However, training a neural network to optimize the t-SNE objective function frequently fails. Previous methods overcome this problem by pre-training and then fine-tuning the network. We found that the training failure comes from the gradient exploding problem, which occurs when data points distant in high-dimensional space are projected to nearby embedding positions. Accordingly, we applied the gradient clipping method to solve the problem. Since the networks are trained by directly optimizing the t-SNE objective function, our method achieves an embedding quality that is compatible with the non-parametric t-SNE while enjoying the ability of generalization. Due to mini-batch network training, our parametric dimension reduction method is highly efficient. We further extended other non-parametric state-of-the-art approaches, such as LargeVis and UMAP, to the parametric versions. Experiment results demonstrate the feasibility of our method. Considering its practicability, we will soon release the codes for public use.


title: Rethinking Evaluation Methodology for Audio-to-Score Alignment

abstract: This paper offers a precise, formal definition of an audio-to-score alignment. While the concept of an alignment is intuitively grasped, this precision affords us new insight into the evaluation of audio-to-score alignment algorithms. Motivated by these insights, we introduce new evaluation metrics for audio-to-score alignment. Using an alignment evaluation dataset derived from pairs of KernScores and MAESTRO performances, we study the behavior of our new metrics and the standard metrics on several classical alignment algorithms.


title: Generation of lyrics lines conditioned on music audio clips

abstract: We present a system for generating novel lyrics lines conditioned on music audio. A bimodal neural network model learns to generate lines conditioned on any given short audio clip. The model consists of a spectrogram variational autoencoder (VAE) and a text VAE. Both automatic and human evaluations demonstrate effectiveness of our model in generating lines that have an emotional impact matching a given audio clip. The system is intended to serve as a creativity tool for songwriters.


title: Toward Privacy and Utility Preserving Image Representation

abstract: Face images are rich data items that are useful and can easily be collected in many applications, such as in 1-to-1 face verification tasks in the domain of security and surveillance systems. Multiple methods have been proposed to protect an individual's privacy by perturbing the images to remove traces of identifiable information, such as gender or race. However, significantly less attention has been given to the problem of protecting images while maintaining optimal task utility. In this paper, we study the novel problem of creating privacy-preserving image representations with respect to a given utility task by proposing a principled framework called the Adversarial Image Anonymizer (AIA). AIA first creates an image representation using a generative model, then enhances the learned image representations using adversarial learning to preserve privacy and utility for a given task. Experiments were conducted on a publicly available data set to demonstrate the effectiveness of AIA as a privacy-preserving mechanism for face images.


title: On a Class of Indefinite Kac-Moody Algebras

abstract: In this paper, we study a special class of indefinite Kac-Moody algebras. Based on the study of hyperbolic Kac-Moody algebras, we give the definition of $N_k$ type Kac-Moody algebras and study some properties of this special type Kac-Moody algebras.


title: Pareto's 80/20 Rule and the Gaussian Distribution

abstract: The statistical state for the empirical Pareto's 80/20 rule has been found to correspond to a normal or Gaussian distribution with a standard deviation that is twice the mean. This finding represents large characteristic variations in our society and nature. In this distribution, the rule can be also referred to as, for example, the 25/5, 45/10, 60/15, or 90/25 rule. In addition, our result suggests the existence of implicit negative contributors.


title: Few-shot Learning for Time-series Forecasting

abstract: Time-series forecasting is important for many applications. Forecasting models are usually trained using time-series data in a specific target task. However, sufficient data in the target task might be unavailable, which leads to performance degradation. In this paper, we propose a few-shot learning method that forecasts a future value of a time-series in a target task given a few time-series in the target task. Our model is trained using time-series data in multiple training tasks that are different from target tasks. Our model uses a few time-series to build a forecasting function based on a recurrent neural network with an attention mechanism. With the attention mechanism, we can retrieve useful patterns in a small number of time-series for the current situation. Our model is trained by minimizing an expected test error of forecasting next timestep values. We demonstrate the effectiveness of the proposed method using 90 time-series datasets.


title: Rotating wave approximation for quadrupole interaction with high spin

abstract: Rotating wave approximation in a quantum spin system driven by a linearly polarized alternating magnetic field with quadrupole interaction presents is investigated in detail in this paper. The conventional way to employ the rotating wave approximation is to assume the dynamics being restricted in the reduced Hilbert space. However, when the driving strength is relatively strong or the driving is off resonant, the leakage from the target resonance subspace along with the effects from the counter-rotating terms cannot be neglected anymore. We propose the rotating wave approximation applied in the full Hilbert space to take the leakage from the target resonance subspace into account. To include the effects from the counter-rotating terms, we utilize the counterrotating hybridized rotating wave method in the reduced Hilbert space. The performance of these rotating wave approximation methods is compared by estimating the state fidelity as well as the operator fidelity and the results reveal that different methods may be employed for different practical circumstances.


title: AutoDSE: Enabling Software Programmers to Design Efficient FPGA Accelerators

abstract: Adopting FPGA as an accelerator in datacenters is becoming mainstream for customized computing, but the fact that FPGAs are hard to program creates a steep learning curve for software programmers. Even with the help of high-level synthesis (HLS), accelerator designers still have to manually perform code reconstruction and cumbersome parameter tuning to achieve the optimal performance. While many learning models have been leveraged by existing work to automate the design of efficient accelerators, the unpredictability of modern HLS tools becomes a major obstacle for them to maintain high accuracy. To address this problem, we propose an automated DSE framework-AutoDSE- that leverages a bottleneck-guided coordinate optimizer to systematically find a better design point. AutoDSE detects the bottleneck of the design in each step and focuses on high-impact parameters to overcome it. The experimental results show that AutoDSE is able to identify the design point that achieves, on the geometric mean, 19.9x speedup over one CPU core for Machsuite and Rodinia benchmarks. Compared to the manually optimized HLS vision kernels in Xilinx Vitis libraries, AutoDSE can reduce their optimization pragmas by 26.38x while achieving similar performance. With less than one optimization pragma per design on average, we are making progress towards democratizing customizable computing by enabling software programmers to design efficient FPGA accelerators.


title: Algebraic Degree Periodicity in Recurrence Sequences

abstract: The degree sequence of the algebraic numbers in an algebraic linear recurrence sequence is shown to be virtually periodic. This is proved using the Skolem-Mahler-Lech theorem. It has applications to the degree sequence and the minimal polynomial sequence for exponential sums over finite fields. The degree periodicity also holds for some more complicated non-linear recurrence sequences. We give one example from the iterations of a polynomial map. This depending on the dynamic Mordell-Lang conjecture which has been proved in some cases.


title: Waveguide-coupled Rydberg spectrum analyzer from 0 to 20 GHz

abstract: We demonstrate an atomic radio-frequency (RF) receiver and spectrum analyzer based on thermal Rydberg atoms coupled to a planar microwave waveguide. We use an off-resonant RF heterodyne technique to achieve continuous operation for carrier frequencies ranging from DC to 20 GHz. The system achieves an intrinsic sensitivity of up to -120(2) dBm/Hz, DC coupling, 4 MHz instantaneous bandwidth, and over 80 dB of linear dynamic range. By connecting through a low-noise preamplifier, we demonstrate high-performance spectrum analysis with peak sensitivity of better than -145 dBm/Hz. Attaching a standard rabbit-ears antenna, the spectrum analyzer detects weak ambient signals including FM radio, AM radio, Wi-Fi, and Bluetooth. We also demonstrate waveguide-readout of the thermal Rydberg ensemble by non-destructively probing waveguide-atom interactions. The system opens the door for small, room-temperature, ensemble-based Rydberg sensors that surpass the sensitivity, bandwidth, and precision limitations of standard RF sensors, receivers, and analyzers.


title: Development of Word Embeddings for Uzbek Language

abstract: In this paper, we share the process of developing word embeddings for the Cyrillic variant of the Uzbek language. The result of our work is the first publicly available set of word vectors trained on the word2vec, GloVe, and fastText algorithms using a high-quality web crawl corpus developed in-house. The developed word embeddings can be used in many natural language processing downstream tasks.


title: AttendNets: Tiny Deep Image Recognition Neural Networks for the Edge via Visual Attention Condensers

abstract: While significant advances in deep learning has resulted in state-of-the-art performance across a large number of complex visual perception tasks, the widespread deployment of deep neural networks for TinyML applications involving on-device, low-power image recognition remains a big challenge given the complexity of deep neural networks. In this study, we introduce AttendNets, low-precision, highly compact deep neural networks tailored for on-device image recognition. More specifically, AttendNets possess deep self-attention architectures based on visual attention condensers, which extends on the recently introduced stand-alone attention condensers to improve spatial-channel selective attention. Furthermore, AttendNets have unique machine-designed macroarchitecture and microarchitecture designs achieved via a machine-driven design exploration strategy. Experimental results on ImageNet$_{50}$ benchmark dataset for the task of on-device image recognition showed that AttendNets have significantly lower architectural and computational complexity when compared to several deep neural networks in research literature designed for efficiency while achieving highest accuracies (with the smallest AttendNet achieving $\sim$7.2% higher accuracy, while requiring $\sim$3$\times$ fewer multiply-add operations, $\sim$4.17$\times$ fewer parameters, and $\sim$16.7$\times$ lower weight memory requirements than MobileNet-V1). Based on these promising results, AttendNets illustrate the effectiveness of visual attention condensers as building blocks for enabling various on-device visual perception tasks for TinyML applications.


title: End-to-End Spoken Language Understanding Without Full Transcripts

abstract: An essential component of spoken language understanding (SLU) is slot filling: representing the meaning of a spoken utterance using semantic entity labels. In this paper, we develop end-to-end (E2E) spoken language understanding systems that directly convert speech input to semantic entities and investigate if these E2E SLU models can be trained solely on semantic entity annotations without word-for-word transcripts. Training such models is very useful as they can drastically reduce the cost of data collection. We created two types of such speech-to-entities models, a CTC model and an attention-based encoder-decoder model, by adapting models trained originally for speech recognition. Given that our experiments involve speech input, these systems need to recognize both the entity label and words representing the entity value correctly. For our speech-to-entities experiments on the ATIS corpus, both the CTC and attention models showed impressive ability to skip non-entity words: there was little degradation when trained on just entities versus full transcripts. We also explored the scenario where the entities are in an order not necessarily related to spoken order in the utterance. With its ability to do re-ordering, the attention model did remarkably well, achieving only about 2% degradation in speech-to-bag-of-entities F1 score.


title: Helical magnetic order and Fermi surface nesting in non-centrosymmetric ScFeGe

abstract: An investigation of the structural, magnetic, thermodynamic, and charge transport properties of non-centrosymmetric hexagonal ScFeGe reveals it to be an anisotropic metal with a transition to a weak itinerant incommensurate helimagnetic state below $T_N = 36$ K. Neutron diffraction measurements discovered a temperature and field independent helical wavevector \textbf{\textit{k}} = (0 0 0.193) with magnetic moments of 0.53 $\mu_{B}$ per formula unit confined to the {\it ab}-plane. Density functional theory calculations are consistent with these measurements and find several bands that cross the Fermi level along the {\it c}-axis with a nearly degenerate set of flat bands just above the Fermi energy. The anisotropy found in the electrical transport is reflected in the calculated Fermi surface, which consists of several warped flat sheets along the $c$-axis with two regions of significant nesting, one of which has a wavevector that closely matches that found in the neutron diffraction. The electronic structure calculations, along with a strong anomaly in the {\it c}-axis conductivity at $T_N$, signal a Fermi surface driven magnetic transition, similar to that found in spin density wave materials. Magnetic fields applied in the {\it ab}-plane result in a metamagnetic transition with a threshold field of $\approx$ 6.7 T along with a sharp, strongly temperature dependent, discontinuity and a change in sign of the magnetoresistance for in-plane currents. Thus, ScFeGe is an ideal system to investigate the effect of in-plane magnetic fields on an easy-plane magnetic system, where the relative strength of the magnetic interactions and anisotropies determine the topology and magnetic structure.


title: Secure Aggregation with Heterogeneous Quantization in Federated Learning

abstract: Secure model aggregation across many users is a key component of federated learning systems. The state-of-the-art protocols for secure model aggregation, which are based on additive masking, require all users to quantize their model updates to the same level of quantization. This severely degrades their performance due to lack of adaptation to available bandwidth at different users. We propose three schemes that allow secure model aggregation while using heterogeneous quantization. This enables the users to adjust their quantization proportional to their available bandwidth, which can provide a substantially better trade-off between the accuracy of training and the communication time. The proposed schemes are based on a grouping strategy by partitioning the network into groups, and partitioning the local model updates of users into segments. Instead of applying aggregation protocol to the entire local model update vector, it is applied on segments with specific coordination between users. We theoretically evaluate the quantization error for our schemes, and also demonstrate how our schemes can be utilized to overcome Byzantine users.


title: Manifold Adaptive Multiple Kernel K-Means for Clustering

abstract: Multiple kernel methods based on k-means aims to integrate a group of kernels to improve the performance of kernel k-means clustering. However, we observe that most existing multiple kernel k-means methods exploit the nonlinear relationship within kernels, whereas the local manifold structure among multiple kernel space is not sufficiently considered. In this paper, we adopt the manifold adaptive kernel, instead of the original kernel, to integrate the local manifold structure of kernels. Thus, the induced multiple manifold adaptive kernels not only reflect the nonlinear relationship but also the local manifold structure. We then perform multiple kernel clustering within the multiple kernel k-means clustering framework. It has been verified that the proposed method outperforms several state-of-the-art baseline methods on a variety of data sets.


title: Anti-interference Computational Ghost Imaging with Pink Noise Speckle Patterns

abstract: We propose a computational ghost imaging scheme using customized pink noise speckle pattern illumination. By modulating the spatial frequency amplitude of the speckles, we generate speckle patterns with a significant positive spatial correlation. We experimentally reconstruct images using our synthesized speckle patterns in the presence of a variety of noise sources and pattern distortion and shown it is robust to noise interference. The results are compared with the use of standard white noise speckle patterns. We show that our method gives good image qualities under different noise interference situations while the traditional way fails. The proposed scheme promises potential applications in underwater, dynamic, and moving target computational ghost imaging.


title: Restricting Majorana phases in the Tri-Bi-Maximal limit

abstract: The Tri-Bi-Maximal pattern has been long investigated as the symmetric scenario that lies behind the neutrino mixing matrix. It predicts a null reactor angle and hence forbids $CP$ violation in the lepton sector, which is in contrast to the current experimental determinations. We explore different deviations from this pattern to restore the compatibility with the latest fits of neutrino mixing parameters. We consider two unitary matrices to correct the symmetric pattern, each of them is written in terms of one single angle and one complex phase, which will be constrained by the experimental mixings and from symmetry restrictions in the mass matrix. We note that these correction parameters would allow us to obtain simultaneous information about the Dirac and Majorana $CP$ phases in some specific scenarios. We show that the predicted values lead to sharped regions for the neutrinoless double beta decay amplitude, in the selected cases, that could be tested with forthcoming results.


title: Few-Mode Fiber Coupling Efficiency for Free-Space Optical Communication

abstract: Few-mode fiber is a significant component of free-space optical communication at the receiver to obtain achievable high coupling efficiency. A theoretical coupling model from the free-space optical communication link to a few-mode fiber is proposed based on a scale-adapted set of Laguerre-Gaussian modes. It is found that the coupling efficiency of various modes behaves differently in the presence of atmospheric turbulence or random jitter. Based on this model, the optimal coupling geometry parameter is obtained to maximize the coupling efficiency of the selected mode of few-mode fiber. The communication performance with random jitter is investigated. It is shown that the few-mode fiber has better bit-error rate performance than single-mode fiber, especially in high signal-to-noise ratio regimes.


title: TensorBNN: Bayesian Inference for Neural Networks using Tensorflow

abstract: TensorBNN is a new package based on TensorFlow that implements Bayesian inference for modern neural network models. The posterior density of neural network model parameters is represented as a point cloud sampled using Hamiltonian Monte Carlo. The TensorBNN package leverages TensorFlow's architecture and training features as well as its ability to use modern graphics processing units (GPU) in both the training and prediction stages.


title: Multiple Word Embeddings for Increased Diversity of Representation

abstract: Most state-of-the-art models in natural language processing (NLP) are neural models built on top of large, pre-trained, contextual language models that generate representations of words in context and are fine-tuned for the task at hand. The improvements afforded by these "contextual embeddings" come with a high computational cost. In this work, we explore a simple technique that substantially and consistently improves performance over a strong baseline with negligible increase in run time. We concatenate multiple pre-trained embeddings to strengthen our representation of words. We show that this concatenation technique works across many tasks, datasets, and model types. We analyze aspects of pre-trained embedding similarity and vocabulary coverage and find that the representational diversity between different pre-trained embeddings is the driving force of why this technique works. We provide open source implementations of our models in both TensorFlow and PyTorch.


title: Can Automatic Post-Editing Improve NMT?

abstract: Automatic post-editing (APE) aims to improve machine translations, thereby reducing human post-editing effort. APE has had notable success when used with statistical machine translation (SMT) systems but has not been as successful over neural machine translation (NMT) systems. This has raised questions on the relevance of APE task in the current scenario. However, the training of APE models has been heavily reliant on large-scale artificial corpora combined with only limited human post-edited data. We hypothesize that APE models have been underperforming in improving NMT translations due to the lack of adequate supervision. To ascertain our hypothesis, we compile a larger corpus of human post-edits of English to German NMT. We empirically show that a state-of-art neural APE model trained on this corpus can significantly improve a strong in-domain NMT system, challenging the current understanding in the field. We further investigate the effects of varying training data sizes, using artificial training data, and domain specificity for the APE task. We release this new corpus under CC BY-NC-SA 4.0 license at https://github.com/shamilcm/pedra.


title: One-dimensional van der Waals heterostructures as efficient metal-free oxygen electrocatalysts

abstract: Two-dimensional covalent organic frameworks (2D-COFs) are an emerging family of catalytical materials with well-defined molecular structures. The stacking of 2D nanosheets and large intrinsic bandgaps significantly impair their performance. Here, we report coaxial one-dimensional van der Waals heterostructures (1D vdWHs) comprised of a carbon nanotube (CNT) core and a thickness tunable thienothiophene-pyrene COF shell using a solution based in situ wrapping method. Density functional theory calculations and in-operando and ex-situ spectroscopic analysis show that the carbon-sulfur region in the thienothiophene groups is the active catalytic site. The unique coaxial structure enables controllable n-doping from the CNT core to the COF shell depending on COF shell thickness, which lowers the bandgap and work function of COF. Consequently, the charge transfer barrier between the active catalytic site and adsorbed oxygen intermediates becomes lower, resulting in a dramatic enhancement in their catalytic activity for oxygen redox reactions. It enables a high-performance rechargeable zinc-air battery with a specific capacity of 696 mAh gZn-1 under a high current density of 40 mA cm-2 and excellent cycling stability. 1D vdWHs open the door to create multi-dimensional vdWHs for exploring fundamental physics and chemistry, as well as practical applications in electrochemistry, electronics, photonics, and beyond.


title: Deep Equals Shallow for ReLU Networks in Kernel Regimes

abstract: Deep networks are often considered to be more expressive than shallow ones in terms of approximation. Indeed, certain functions can be approximated by deep networks provably more efficiently than by shallow ones, however, no tractable algorithms are known for learning such deep models. Separately, a recent line of work has shown that deep networks trained with gradient descent may behave like (tractable) kernel methods in a certain over-parameterized regime, where the kernel is determined by the architecture and initialization, and this paper focuses on approximation for such kernels. We show that for ReLU activations, the kernels derived from deep fully-connected networks have essentially the same approximation properties as their shallow two-layer counterpart, namely the same eigenvalue decay for the corresponding integral operator. This highlights the limitations of the kernel framework for understanding the benefits of such deep architectures. Our main theoretical result relies on characterizing such eigenvalue decays through differentiability properties of the kernel function, which also easily applies to the study of other kernels defined on the sphere.


title: Classifying complements for conformal algebras

abstract: Let $R\subseteq E$ be two Lie conformal algebras and $Q$ be a given complement of $R$ in $E$. Classifying complements problem asks for describing and classifying all complements of $R$ in $E$ up to an isomorphism. It is known that $E$ is isomorphic to a bicrossed product of $R$ and $Q$. We show that any complement of $R$ in $E$ is isomorphic to a deformation of $Q$ associated to the bicrossed product. A classifying object is constructed to parameterize all $R$-complements of $E$. Several explicit examples are provided. Similarly, we also develop a classifying complements theory of associative conformal algebras.


title: Transfer Learning from Speech Synthesis to Voice Conversion with Non-Parallel Training Data

abstract: This paper presents a novel framework to build a voice conversion (VC) system by learning from a text-to-speech (TTS) synthesis system, that is called TTS-VC transfer learning. We first develop a multi-speaker speech synthesis system with sequence-to-sequence encoder-decoder architecture, where the encoder extracts robust linguistic representations of text, and the decoder, conditioned on target speaker embedding, takes the context vectors and the attention recurrent network cell output to generate target acoustic features. We take advantage of the fact that TTS system maps input text to speaker independent context vectors, and reuse such a mapping to supervise the training of latent representations of an encoder-decoder voice conversion system. In the voice conversion system, the encoder takes speech instead of text as input, while the decoder is functionally similar to TTS decoder. As we condition the decoder on speaker embedding, the system can be trained on non-parallel data for any-to-any voice conversion. During voice conversion training, we present both text and speech to speech synthesis and voice conversion networks respectively. At run-time, the voice conversion network uses its own encoder-decoder architecture. Experiments show that the proposed approach outperforms two competitive voice conversion baselines consistently, namely phonetic posteriorgram and variational autoencoder methods, in terms of speech quality, naturalness, and speaker similarity.


title: Motivic action on coherent cohomology of Hilbert modular varieties

abstract: We propose an action of a certain motivic cohomology group on the coherent cohomology of Hilbert modular varieties, extending conjectures of Venkatesh, Prasanna, and Harris. The action is described in two ways: on cohomology modulo $p$ and over $\mathbb C$, and we conjecture that they both lift to an action on cohomology with integral coefficients. The conjecture is supported by theoretical evidence based on Stark's conjecture on special values of Artin $L$-functions, and by numerical evidence in base change cases.


title: Using sex and gender in survey adjustment

abstract: Accounting for sex and gender is a challenge in social science research. While other methodology papers consider issues surrounding appropriate measurement, we consider the problem of adjustment for survey nonresponse and generalization from samples to populations in the context of the recent push toward measuring sex or gender as a non-binary construct. This is challenging not only in that response categories differ between sex and gender measurement, but also in that both these attributes are potentially multidimensional. We reflect on similarities to measuring race/ethnicity before considering the ethical and statistical implications of the options available to us. We present a simulation study to understand the statistical implications under a variety of scenarios, and demonstrate the application of the decision process with the New York City Poverty Tracker. Overall, we conclude not with a single best recommendation for all surveys but rather with an awareness of the complexity of the problem and the benefits and weaknesses of different approaches.


title: Statistical Mechanics of Dislocation Pileups in Two Dimensions

abstract: Dislocation pileups directly impact the material properties of crystalline solids through the arrangement and collective motion of interacting dislocations. We study the statistical mechanics of these ordered defect structures embedded in two dimensional crystals, where the dislocations themselves form one-dimensional lattices. In particular, pileups exemplify a new class of inhomogeneous crystals characterized by spatially varying lattice spacings. By analytically formulating key statistical quantities and comparing our theory to numerical experiments using an intriguing mapping of dislocation positions onto the eigenvalues of recently studied random matrix ensembles, we uncover two types of one-dimensional phase transitions in dislocation pileups: a thermal depinning transition out of long-range translational order from the pinned-defect phase, due to a periodic Peierls potential, to a floating-defect state, and finally the melting out of a quasi-long range ordered floating defect-solid phase to a defect-liquid. We also find the set of transition temperatures at which these transitions can be directly observed through the one-dimensional structure factor, where the delta function Bragg peaks, at the pinned-defect to floating-defect transition, broaden into algebraically diverging Bragg peaks, which then sequentially disappear as one approaches the two-dimensional melting transition of the host crystal. We calculate a set of temperature-dependent critical exponents for the structure factor and radial distribution function, and obtain their exact forms for both uniform and inhomogeneous pileups using random matrix theory.


title: Beam data modeling of linear accelerators (linacs) through machine learning and its potential applications in fast and robust linac commissioning and quality assurance

abstract: Background and purpose: To propose a novel machine learning-based method for reliable and accurate modeling of linac beam data applicable to the processes of linac commissioning and QA. Materials and methods: We hypothesize that the beam data is a function of inherent linac features and percentage depth doses (PDDs) and profiles of different field sizes are correlated with each other. The correlation is formulated as a multivariable regression problem using a machine learning framework. Varian TrueBeam beam data sets (n=43) acquired from multiple institutions were used to evaluate the framework. The data sets included PDDs and profiles across different energies and field sizes. A multivariate regression model was trained for prediction of beam specific PDDs and profiles of different field sizes using a 10x10cm$^2$ field as input. Results: Predictions of PDDs were achieved with a mean absolute percent relative error (%RE) of 0.19-0.35% across the different beam energies investigated. The maximum mean absolute %RE was 0.93%. For profile prediction, the mean absolute %RE was 0.66-0.93% with a maximum absolute %RE of 3.76%. The largest uncertainties in the PDD and profile predictions were found at the build-up region and at the field penumbra, respectively. The prediction accuracy increased with the number of training sets up to around 20 training sets. Conclusions: Through this novel machine learning-based method we have shown accurate and reproducible generation of beam data for linac commissioning for routine radiation therapy. This method has the potential to simplify the linac commissioning procedure, save time and manpower while increasing the accuracy of the commissioning process.


title: Learning to Reflect and to Beamform for Intelligent Reflecting Surface with Implicit Channel Estimation

abstract: Intelligent reflecting surface (IRS), which consists of a large number of tunable reflective elements, is capable of enhancing the wireless propagation environment in a cellular network by intelligently reflecting the electromagnetic waves from the base-station (BS) toward the users. The optimal tuning of the phase shifters at the IRS is, however, a challenging problem, because due to the passive nature of reflective elements, it is difficult to directly measure the channels between the IRS, the BS, and the users. Instead of following the traditional paradigm of first estimating the channels then optimizing the system parameters, this paper advocates a machine learning approach capable of directly optimizing both the beamformers at the BS and the reflective coefficients at the IRS based on a system objective. This is achieved by using a deep neural network to parameterize the mapping from the received pilots (plus any additional information, such as the user locations) to an optimized system configuration, and by adopting a permutation invariant/equivariant graph neural network (GNN) architecture to capture the interactions among the different users in the cellular network. Simulation results show that the proposed implicit channel estimation based approach is generalizable, can be interpreted, and can efficiently learn to maximize a sum-rate or minimum-rate objective from a much fewer number of pilots than the traditional explicit channel estimation based approaches.


title: Teacher-Critical Training Strategies for Image Captioning

abstract: Existing image captioning models are usually trained by cross-entropy (XE) loss and reinforcement learning (RL), which set ground-truth words as hard targets and force the captioning model to learn from them. However, the widely adopted training strategies suffer from misalignment in XE training and inappropriate reward assignment in RL training. To tackle these problems, we introduce a teacher model that serves as a bridge between the ground-truth caption and the caption model by generating some easier-to-learn word proposals as soft targets. The teacher model is constructed by incorporating the ground-truth image attributes into the baseline caption model. To effectively learn from the teacher model, we propose Teacher-Critical Training Strategies (TCTS) for both XE and RL training to facilitate better learning processes for the caption model. Experimental evaluations of several widely adopted caption models on the benchmark MSCOCO dataset show the proposed TCTS comprehensively enhances most evaluation metrics, especially the Bleu and Rouge-L scores, in both training stages. TCTS is able to achieve to-date the best published single model Bleu-4 and Rouge-L performances of 40.2% and 59.4% on the MSCOCO Karpathy test split. Our codes and pre-trained models will be open-sourced.


title: Bilateral Asymmetry Guided Counterfactual Generating Network for Mammogram Classification

abstract: Mammogram benign or malignant classification with only image-level labels is challenging due to the absence of lesion annotations. Motivated by the symmetric prior that the lesions on one side of breasts rarely appear in the corresponding areas on the other side, given a diseased image, we can explore a counterfactual problem that how would the features have behaved if there were no lesions in the image, so as to identify the lesion areas. We derive a new theoretical result for counterfactual generation based on the symmetric prior. By building a causal model that entails such a prior for bilateral images, we obtain two optimization goals for counterfactual generation, which can be accomplished via our newly proposed counterfactual generative network. Our proposed model is mainly composed of Generator Adversarial Network and a \emph{prediction feedback mechanism}, they are optimized jointly and prompt each other. Specifically, the former can further improve the classification performance by generating counterfactual features to calculate lesion areas. On the other hand, the latter helps counterfactual generation by the supervision of classification loss. The utility of our method and the effectiveness of each module in our model can be verified by state-of-the-art performance on INBreast and an in-house dataset and ablation studies.


title: Relay Pursuit of an Evader by a Heterogeneous Group of Pursuers Using Potential Games

abstract: We propose a decentralized solution for a pursuit-evasion game involving a heterogeneous group of rational (selfish) pursuers and a single evader based on the framework of potential games. In the proposed game, the evader aims to delay (or, if possible, avoid) capture by any of the pursuers whereas each pursuer tries to capture the latter only if this is to his best interest. Our approach resembles in principle the so-called relay pursuit strategy introduced in [1], in which only the pursuer that can capture the evader faster than the others is active. In sharp contrast with the latter approach, the active pursuer herein is not determined by a reactive ad-hoc rule but from the solution of a corresponding potential game. We assume that each pursuer has different capabilities and his decision whether to go after the evader or not is based on the maximization of his individual utility (conditional on the choices and actions of the other pursuers). The pursuers' utilities depend on both the rewards that they will receive by capturing the evader and the time of capture (cost of capturing the evader) so that a pursuer should only seek capture when the incurred cost is relatively small. The determination of the active pursuer-evader assignments (in other words, which pursuers should be active) is done iteratively by having the pursuers exchange information and updating their own actions by executing a learning algorithm for games known as Spatial Adaptive Play (SAP). We illustrate the performance of our algorithm by means of extensive numerical simulations.


title: On The Quest For Economic Prosperity: A Higher Education Strategic Perspective For The Mena Region

abstract: In a fast-changing technology-driven era, drafting an implementable strategic roadmap to achieve economic prosperity becomes a real challenge. Although the national and international strategic development plans may vary, they usually target the improvement of the quality of living standards through boosting the national GDP per capita and the creation of decent jobs. There is no doubt that human capacity building, through higher education, is vital to the availability of highly qualified workforce supporting the implementation of the aforementioned strategies. In other words, fulfillment of most strategic development plan goals becomes dependent on the drafting and implementation of successful higher education strategies. For MENA region countries, this is particularly crucial due to many specific challenges, some of which are different from those facing developed nations. More details on the MENA region higher education strategic planning challenges as well as the proposed higher education strategic requirements to support national economic prosperity and fulfill the 2030 UN SDGs are given in the paper.


title: AUBER: Automated BERT Regularization

abstract: How can we effectively regularize BERT? Although BERT proves its effectiveness in various downstream natural language processing tasks, it often overfits when there are only a small number of training instances. A promising direction to regularize BERT is based on pruning its attention heads based on a proxy score for head importance. However, heuristic-based methods are usually suboptimal since they predetermine the order by which attention heads are pruned. In order to overcome such a limitation, we propose AUBER, an effective regularization method that leverages reinforcement learning to automatically prune attention heads from BERT. Instead of depending on heuristics or rule-based policies, AUBER learns a pruning policy that determines which attention heads should or should not be pruned for regularization. Experimental results show that AUBER outperforms existing pruning methods by achieving up to 10% better accuracy. In addition, our ablation study empirically demonstrates the effectiveness of our design choices for AUBER.


title: Pruning Filter in Filter

abstract: Pruning has become a very powerful and effective technique to compress and accelerate modern neural networks. Existing pruning methods can be grouped into two categories: filter pruning (FP) and weight pruning (WP). FP wins at hardware compatibility but loses at the compression ratio compared with WP. To converge the strength of both methods, we propose to prune the filter in the filter. Specifically, we treat a filter $F \in \mathbb{R}^{C\times K\times K}$ as $K \times K$ stripes, i.e., $1\times 1$ filters $\in \mathbb{R}^{C}$, then by pruning the stripes instead of the whole filter, we can achieve finer granularity than traditional FP while being hardware friendly. We term our method as SWP (\emph{Stripe-Wise Pruning}). SWP is implemented by introducing a novel learnable matrix called Filter Skeleton, whose values reflect the shape of each filter. As some recent work has shown that the pruned architecture is more crucial than the inherited important weights, we argue that the architecture of a single filter, i.e., the shape, also matters. Through extensive experiments, we demonstrate that SWP is more effective compared to the previous FP-based methods and achieves the state-of-art pruning ratio on CIFAR-10 and ImageNet datasets without obvious accuracy drop. Code is available at https://github.com/fxmeng/Pruning-Filter-in-Filter


title: Uncertainty Estimation and Sample Selection for Crowd Counting

abstract: We present a method for image-based crowd counting, one that can predict a crowd density map together with the uncertainty values pertaining to the predicted density map. To obtain prediction uncertainty, we model the crowd density values using Gaussian distributions and develop a convolutional neural network architecture to predict these distributions. A key advantage of our method over existing crowd counting methods is its ability to quantify the uncertainty of its predictions. We illustrate the benefits of knowing the prediction uncertainty by developing a method to reduce the human annotation effort needed to adapt counting networks to a new domain. We present sample selection strategies which make use of the density and uncertainty of predictions from the networks trained on one domain to select the informative images from a target domain of interest to acquire human annotation. We show that our sample selection strategy drastically reduces the amount of labeled data from the target domain needed to adapt a counting network trained on a source domain to the target domain. Empirically, the networks trained on UCF-QNRF dataset can be adapted to surpass the performance of the previous state-of-the-art results on NWPU dataset and Shanghaitech dataset using only 17$\%$ of the labeled training samples from the target domain.


title: Time-resolved spectroscopy and photometry of an M dwarf flare star YZ Canis Minoris with OISTER and TESS: Blue asymmetry in H$\alpha$ line during the non-white light flare

abstract: In this paper, we present the results from spectroscopic and photometric observations of the M-type flare star YZ CMi in the framework of the Optical and Infrared Synergetic Telescopes for Education and Research (OISTER) collaborations during the Transiting Exoplanet Survey Satellite (TESS) observation period. We detected 145 white-light flares from the TESS light curve and 4 H$\alpha$ flares from the OISTER observations performed between 2019-01-16 and 2019-01-18. Among them, 3 H$\alpha$ flares were associated with white-light flares. However, one of them did not show clear brightening in continuum; during this flare, the H$\alpha$ line exhibited blue-asymmetry which has lasted for $\sim 60$ min. The line of sight velocity of the blue-shifted component is $-80$ - $-100$ km s$^{-1}$. This suggests that there can be upward flows of chromospheric cool plasma even without detectable red/NIR continuum brightening. By assuming that the blue-asymmetry in H$\alpha$ line was caused by a prominence eruption on YZ CMi, we estimated the mass and kinetic energy of the upward-moving material to be $10^{16}$ - $10^{18}$ g and $10^{29.5}$ - $10^{31.5}$ erg, respectively. The estimated mass is comparable to expectations from the empirical relation between the flare X-ray energy and mass of upward-moving material for stellar flares and solar CMEs. In contrast, the estimated kinetic energy for the non-white-light flare on YZ CMi is roughly $2$ orders of magnitude smaller than that expected from the relation between flare X-ray energy and kinetic energy for solar CMEs. This could be understood by the difference in the velocity between CMEs and prominence eruptions.


title: Intense high harmonic vector beams from relativistic plasma mirrors

abstract: Vector beam, with a spatial nonuniform polarization distribution, is important for many applications due to its unique field characteristics and novel effects when interacting with matter. Here through three-dimensional particle-in-cell simulations, we demonstrate that intense vector beams in the extreme-ultraviolet to x-ray spectral region can be generated by means of high harmonic generation (HHG) in the relativistic regime. The vector features of the fundamental laser beam can be transferred to the higher frequency emission coherently during the extreme nonlinear HHG dynamics from relativistic plasma mirrors. The vector harmonic beams can be synthesized into attosecond vector beams. It is also possible to generate vector harmonic beam carrying orbital angular momentum. Such bright vortices and vector light sources present new opportunities in various applications such as imaging with high spatial and temporal resolution, ultrafast magnetic spectroscopy, and particle manipulation.


title: CTDGM: A Data Grouping Model Based on Cache Transaction for Unstructured Data Storage Systems

abstract: Cache prefetching technology has become the mainstream data access optimization strategy in the data centers. However, the rapidly increasing of unstructured data generates massive pairwise access relationships, which can result in a heavy computational burden for the existing prefetching model and lead to severe degradation in the performance of data access. We propose cache-transaction-based data grouping model (CTDGM) to solve the problems described above by optimizing the feature representation method and grouping efficiency. First, we provide the definition of the cache transaction and propose the method for extracting the cache transaction feature (CTF). Second, we design a data chunking algorithm based on CTF and spatiotemporal locality to optimize the relationship calculation efficiency. Third, we propose CTDGM by constructing a relation graph that groups data into independent groups according to the strength of the data access relation. Based on the results of the experiment, compared with the state-of-the-art methods, our algorithm achieves an average increase in the cache hit rate of 12% on the MSR dataset with small cache size (0.001% of all the data), which in turn reduces the number of data I/O accesses by 50% when the cache size is less than 0.008% of all the data.


title: FMCW SAR with New Synthesis Method Based on A-SPC Technique

abstract: Frequency modulated continuous wave (FMCW) radar is emerging as a trendy radar system for synthetic aperture radar (SAR). This letter proposes a novel method for the extraction of the SAR image with the FMCW radar. The proposed method can improve the quality of the SAR image. For the verification, we built an automobile SAR (AutoSAR) system and conducted experiments to extract the SAR map by using the AutoSAR system. Then, we synthesized SAR images through both the conventional method and the proposed method to demonstrate the performance of the proposed method. The experimental results show that the SAR image has been successfully improved by the proposed method.


title: Improved Knowledge Distillation via Full Kernel Matrix Transfer

abstract: Knowledge distillation is an effective way for model compression in deep learning. Given a large model (i.e., teacher model), it aims to improve the performance of a compact model (i.e., student model) by transferring the information from the teacher. Various information for distillation has been studied. Recently, a number of works propose to transfer the pairwise similarity between examples to distill relative information. However, most of efforts are devoted to developing different similarity measurements, while only a small matrix consisting of examples within a mini-batch is transferred at each iteration that can be inefficient for optimizing the pairwise similarity over the whole data set. In this work, we aim to transfer the full similarity matrix effectively. The main challenge is from the size of the full matrix that is quadratic to the number of examples. To address the challenge, we decompose the original full matrix with Nystr{\"{o}}m method. By selecting appropriate landmark points, our theoretical analysis indicates that the loss for transfer can be further simplified. Concretely, we find that the difference between the original full kernel matrices between teacher and student can be well bounded by that of the corresponding partial matrices, which only consists of similarities between original examples and landmark points. Compared with the full matrix, the size of the partial matrix is linear in the number of examples, which improves the efficiency of optimization significantly. The empirical study on benchmark data sets demonstrates the effectiveness of the proposed algorithm. Code is available at \url{https://github.com/idstcv/KDA}.


title: Interplay of CMB Temperature, Space Curvature, and Expansion Rate Parameters

abstract: The cosmic microwave background (CMB) temperature, $T$, surely the most precisely measured cosmological parameter, has been inferred from {\it local} measurements of the blackbody spectrum to an exquisite precision of 1 part in $\sim 4700$. On the other hand, current precision allows inference of other basic cosmological parameters at the $\sim 1\%$ level from CMB power spectra, galaxy correlation and lensing, luminosity distance measurements of supernovae, as well as other cosmological probes. A basic consistency check of the standard cosmological model is an independent inference of $T$ at recombination. In this work we first use the recent Planck data, supplemented by either the first year data release of the dark energy survey (DES), baryon acoustic oscillations (BAO) data, and the Pantheon SNIa catalog, to extract $T$ at the $\sim 1\%$ precision level. We then explore correlations between $T$, the Hubble parameter, $H_{0}$, and the global spatial curvature parameter, $\Omega_{k}$. Our parameter estimation indicates that imposing the local constraint from the SH0ES experiment on $H_{0}$ results in significant statistical preference for departure at recombination from the locally inferred $T$. However, only moderate evidence is found in this analysis for tension between local and cosmological estimates of $T$, if the local constraint on $H_{0}$ is relaxed. All other dataset combinations that include the CMB with either BAO, SNIa, or both, disfavor the addition of a new free temperature parameter even in the presence of the local constraint on $H_{0}$. Analysis limited to the Planck dataset suggests the temperature at recombination was higher than expected at recombination at the $\gtrsim 95\%$ confidence level if space is globally flat.


title: Substation-Level Grid Topology Optimization Using Bus Splitting

abstract: Operations of substation circuit breakers are important for maintenance needs and topology reconfiguration in power systems. Bus splitting is one type of topology change where the two bus bars at a substation can become electrically disconnected under certain actions of circuit breakers. Because these events involve detailed substation modeling, they are typically not considered in routine power system operation and control. In this paper, an improved substation-level topology optimization framework is developed by expanding traditional line switching decisions by breaker-level bus splitting, which can further reduce grid congestion and generation costs. A tight McCormick relaxation is proposed to reformulate the bilinear terms in the resultant optimization problem to linear inequality constraints. Thus, a tractable mixed-integer linear program reformulation is attained that allows for efficient solutions in real-time operations. Numerical studies on the IEEE 14-bus and 118-bus systems demonstrate the computational performance and economic benefits of the proposed topology optimization approach.


title: Measuring the distance to the black hole candidate X-ray binary MAXI J1348-630 using HI absorption

abstract: We present HI absorption spectra of the black hole candidate X-ray binary (XRB) MAXI J1348-630 using the Australian Square Kilometre Array Pathfinder (ASKAP) and MeerKAT. The ASKAP HI spectrum shows a maximum negative radial velocity (with respect to the local standard of rest) of $-31\pm4$ km s$^{-1}$ for MAXI J1348-630, as compared to $-50\pm4$ km s$^{-1}$ for a stacked spectrum of several nearby extragalactic sources. This implies a most probable distance of $2.2^{+0.5}_{-0.6}$ kpc for MAXI J1348-630, and a strong upper limit of the tangent point distance at $5.3\pm0.1$ kpc. Our preferred distance implies that MAXI J1348-630 reached $17\pm10$ % of the Eddington luminosity at the peak of its outburst, and that the source transited from the soft to the hard X-ray spectral state at $2.5\pm1.5$ % of the Eddington luminosity. The MeerKAT HI spectrum of MAXI J1348-630 (obtained from the older, low-resolution 4k mode) is consistent with the re-binned ASKAP spectrum, highlighting the potential of the eventual capabilities of MeerKAT for XRB spectral line studies.


title: Towards Adaptive Semantic Segmentation by Progressive Feature Refinement

abstract: As one of the fundamental tasks in computer vision, semantic segmentation plays an important role in real world applications. Although numerous deep learning models have made notable progress on several mainstream datasets with the rapid development of convolutional networks, they still encounter various challenges in practical scenarios. Unsupervised adaptive semantic segmentation aims to obtain a robust classifier trained with source domain data, which is able to maintain stable performance when deployed to a target domain with different data distribution. In this paper, we propose an innovative progressive feature refinement framework, along with domain adversarial learning to boost the transferability of segmentation networks. Specifically, we firstly align the multi-stage intermediate feature maps of source and target domain images, and then a domain classifier is adopted to discriminate the segmentation output. As a result, the segmentation models trained with source domain images can be transferred to a target domain without significant performance degradation. Experimental results verify the efficiency of our proposed method compared with state-of-the-art methods.


title: A Virtual Reality Game as a Tool to Assess Physiological Correlations of Stress

abstract: The objective of this study is to develop and use a virtual reality game as a tool to assess the effects of realistic stress on the behavioral and physiological responses of participants. The game is based on a popular Steam game called Keep Talking Nobody Explodes, where the player collaborates with another person to defuse a bomb. Varying levels of difficulties in solving a puzzle and time pressures will result in different stress levels that can be measured in terms of errors, response time lengths, and other physiological measurements. The game was developed using 3D programming tools including Blender and virtual reality development kit (VRTK). To measure response times accurately, we added LSL (Lab Stream Layer) Markers to collect and synchronize physiological signals, behavioral data, and the timing of game events. We recorded Electrocardiogram (ECG) data during gameplay to assess heart rate and heart-rate variability (HRV) that have been shown as reliable indicators of stress. Our empirical results showed that heart rate increased significantly while HRV reduced significantly when the participants under high stress, which are consistent with the prior mainstream stress research. We further experimented with other tools to enhance communication between two players under adverse conditions and found that an automatic speech recognition software effectively enhanced the communication between the players by displaying keywords into the player's headset that lead to the facilitation of finding the solution of the puzzles or modules. This VR game framework is publicly available in Github and allows researchers to measure and synchronize other physiological signals such as electroencephalogram, electromyogram, and pupillometry.


title: Small Drone Classification with Light CNN and New Micro-Doppler Signature Extraction Method Based on A-SPC Technique

abstract: As the threats of small drones increase, not only the detection but also the classification of small drones has become important. Many recent studies have applied an approach to utilize the micro-Doppler signature (MDS) for the small drone classification by using frequency modulated continuous wave (FMCW) radars. In this letter, we propose a novel method to extract the MDS images of the small drones with the FMCW radar. Moreover, we propose a light convolutional neural network (CNN) whose structure is straightforward, and the number of parameters is quite small for fast classification. The proposed method contributes to increasing the classification accuracy by improving the quality of MDS images. We classified the small drones with the MDS images extracted by the conventional method and the proposed method through the proposed CNN. The experimental results showed that the total classification accuracy was increased by 10.00 % due to the proposed method. The total classification accuracy was recorded at 97.14 % with the proposed MDS extraction method and the proposed light CNN.


title: Modulation of Landau levels and de Haas-van Alphen oscillation in magnetized graphene by uniaxial tensile strain/ stress

abstract: The strain engineering technique allows us to alter the electronic properties of graphene in various ways. Within the continuum approximation, the influences of strain result in the appearance of a pseudo-gauge field and modulated Fermi velocity. In this study, we investigate theoretically the effect of linear uniaxial tensile strain and/or stress, which makes the Fermi velocity anisotropic, on a magnetized graphene sheet in the presence of an applied electrostatic voltage. More specifically, we analyze the consequences of the anisotropic nature of the Fermi velocity on the structure Landau levels and de Haas - van Alphen (dHvA) quantum oscillation in the magnetized graphene sheet. The effect of the direction of the applied strain has also been discussed.


title: Competing effective interactions of Dirac electrons in the Spin-Fermion system

abstract: Recently discovered advanced materials, such as heavy fermions, frequently exhibit a rich phase diagram suggesting the presence of different competing interactions. A unified description of the origin of these multiple interactions, albeit very important for the comprehension of such materials is, in general not available. It would be therefore very useful to have a simple model where the common source of different interactions could be possibly traced back. In this work we consider a system consisting in a set of localized spins on a square lattice with antiferromagnetic nearest neighbors interactions and itinerant electrons, which are assumed to be Dirac-like and interact with the localized spins through a Kondo magnetic interaction. This system is conveniently described by the Spin-Fermion model, which we use in order to determine the effective interactions among the itinerant electrons. By integrating out the localized degrees of freedom we obtain a set of different interactions, which includes: a BCS-like superconducting term, a Nambu-Jona-Lasinio-like, excitonic term and a spin-spin magnetic term. The resulting phase diagram is investigated by evaluation of the mean-field free-energy as a function of the relevant order parameters. This shows the competition of the above interactions, depending on the temperature, chemical potential and coupling constants.


title: A quantum critical superconducting phase transition in quasi-two-dimensional systems with Dirac electrons

abstract: We present a theory describing the superconducting (SC) interaction of Dirac electrons in a quasi-two-dimensional system consisting of a stack of N planes. The occurrence of a SC phase is investigated both at T = 0 and T 5 0. At T = 0, we find a quantum phase transition connecting the normal and SC phases. Our theory qualitatively reproduces the SC phase transition occurring in the underdoped regime of the high-Tc cuprates. This fact points to the possible relevance of Dirac electrons in the mechanism of high-Tc superconductivity.


title: Pairbot: A Novel Model for Autonomous Mobile Robot Systems Consisting of Paired Robots

abstract: Programmable matter consists of many self-organizing computational entities which are autonomous and cooperative with one another to achieve a goal and it has been widely studied in various fields, e.g., robotics or mobile agents, theoretically and practically. In the field of computer science, programmable matter can be theoretically modeled as a distributed system consisting of simple and small robots equipped with limited capabilities, e.g., no memory and/or no geometrical coordination. A lot of theoretical research is studied based on such theoretical models, to clarify the relation between the solvability of various problems and the considered models. We newly propose a computational model named Pairbot model where two autonomous mobile robots operate as a pair on a grid plane. In Pairbot model, every robot has the one robot as its unique partner, called buddy, each other. We call the paired two robots pairbot. Two robots in one pairbot can recognize each other, and repeatedly change their geometrical relationships, long and short, to achieve the goal. In this paper, as a first step to show the feasibility and effectiveness of the proposed Pairbot model, we introduce two simple problems, the marching problem and the object coating problem, and propose two algorithms to solve these two problems, respectively. In both algorithms, it is assumed that the visibility range is one (every robot can observe only its neighboring robots) and the scheduler is asynchronous (ASYNC).


title: Coding of billiards in hyperbolic 3-space

abstract: In this paper, we extend the scope of symbolic dynamics to encompass a specific class of ideal polyhedrons in the 3-dimensional hyperbolic space, marking an important step forward in the exploration of dynamical systems in non-Euclidean spaces. Within the context of billiard dynamics, we construct a novel coding system for these ideal polyhedrons, thereby discretizing their state and time space into symbolic representations. This paper distinguishes itself through the establishment of a conjugacy between the space of pointed billiard trajectories and the associated shift space of codes. A crucial finding herein is the observation that the closure of the related shift space emerges as a subshift of finite type (SFT), elucidating the structural aspects and asymptotic behaviour of these systems.


title: A General Framework for Charger Scheduling Optimization Problems

abstract: This paper presents a general framework to tackle a diverse range of NP-hard charger scheduling problems, optimizing the trajectory of mobile chargers to prolong the life of Wireless Rechargeable Sensor Network (WRSN), a system consisting of sensors with rechargeable batteries and mobile chargers. Existing solutions to charger scheduling problems require problem-specific design and a trade-off between the solution quality and computing time. Instead, we observe that instances of the same type of charger scheduling problem are solved repeatedly with similar combinatorial structure but different data. We consider searching an optimal charger scheduling as a trial and error process, and the objective function of a charging optimization problem as reward, a scalar feedback signal for each search. We propose a deep reinforcement learning-based charger scheduling optimization framework. The biggest advantage of the framework is that a diverse range of domain-specific charger scheduling strategy can be learned automatically from previous experiences. A framework also simplifies the complexity of algorithm design for individual charger scheduling optimization problem. We pick three representative charger scheduling optimization problems, design algorithms based on the proposed deep reinforcement learning framework, implement them, and compare them with existing ones. Extensive simulation results show that our algorithms based on the proposed framework outperform all existing ones.


title: Homogenization for nonlocal evolution problems with three different smooth kernels

abstract: In this paper we consider the homogenization of the evolution problem associated with a jump process that involves three different smooth kernels that govern the jumps to/from different parts of the domain. We assume that the spacial domain is divided into a sequence of two subdomains $A_n \cup B_n$ and we have three different smooth kernels, one that controls the jumps from $A_n$ to $A_n$, a second one that controls the jumps from $B_n$ to $B_n$ and the third one that governs the interactions between $A_n$ and $B_n$.Assuming that $\chi_{A_n} (x) \to X(x)$ weakly in $L^\infty$ (and then $\chi_{B_n} (x) \to 1-X(x)$ weakly in $L^\infty$) as $n \to \infty$ and that the initial condition is given by a density $u_0$ in $L^2$ we show that there is an homogenized limit system in which the three kernels and the limit function $X$ appear. When the initial condition is a delta at one point, $\delta_{\bar{x}}$ (this corresponds to the process that starts at $\bar{x}$) we show that there is convergence along subsequences such that $\bar{x} \in A_{n_j}$ or $\bar{x} \in B_{n_j}$ for every $n_j$ large enough. We also provide a probabilistic interpretation of this evolution equation in terms of a stochastic process that describes the movement of a particle that jumps in $\Omega$ according to the three different kernels and show that the underlying process converges in distribution to a limit process associated with the limit equation. We focus our analysis in Neumann type boundary conditions and briefly describe at the end how to deal with Dirichlet boundary conditions.


title: A Theoretical Study of (Full) Tabled Constraint Logic Programming

abstract: Logic programming with tabling and constraints (TCLP, tabled constraint logic programming) has been shown to be more expressive and, in some cases, more efficient than LP, CLP, or LP with tabling. In this paper we provide insights regarding the semantics, correctness, completeness, and termination of top-down execution strategies for full TCLP, i.e., TCLP featuring entailment checking in the calls and in the answers. We present a top-down semantics for TCLP and show that it is equivalent to a fixpoint semantics. We study how the constraints that a program generates can effectively impact termination, even for constraint classes that are not constraint compact, generalizing previous results. We also present how different variants of constraint projection impact the correctness and completeness of TCLP implementations. All of the presented characteristics are implemented (or can be experimented with) in Mod TCLP, a modular framework for Tabled Constraint Logic Programming, part of the Ciao Prolog logic programming system.


title: Accelerating Optimization and Reinforcement Learning with Quasi-Stochastic Approximation

abstract: The ODE method has been a workhorse for algorithm design and analysis since the introduction of the stochastic approximation. It is now understood that convergence theory amounts to establishing robustness of Euler approximations for ODEs, while theory of rates of convergence requires finer analysis. This paper sets out to extend this theory to quasi-stochastic approximation, based on algorithms in which the "noise" is based on deterministic signals. The main results are obtained under minimal assumptions: the usual Lipschitz conditions for ODE vector fields, and it is assumed that there is a well defined linearization near the optimal parameter $\theta^*$, with Hurwitz linearization matrix $A^*$. The main contributions are summarized as follows: (i) If the algorithm gain is $a_t=g/(1+t)^\rho$ with $g>0$ and $\rho\in(0,1)$, then the rate of convergence of the algorithm is $1/t^\rho$. There is also a well defined "finite-$t$" approximation: \[ a_t^{-1}\{\Theta_t-\theta^*\}=\bar{Y}+\Xi^{\mathrm{I}}_t+o(1) \] where $\bar{Y}\in\mathbb{R}^d$ is a vector identified in the paper, and $\{\Xi^{\mathrm{I}}_t\}$ is bounded with zero temporal mean. (ii) With gain $a_t = g/(1+t)$ the results are not as sharp: the rate of convergence $1/t$ holds only if $I + g A^*$ is Hurwitz. (iii) Based on the Ruppert-Polyak averaging of stochastic approximation, one would expect that a convergence rate of $1/t$ can be obtained by averaging: \[ \Theta^{\text{RP}}_T=\frac{1}{T}\int_{0}^T \Theta_t\,dt \] where the estimates $\{\Theta_t\}$ are obtained using the gain in (i). The preceding sharp bounds imply that averaging results in $1/t$ convergence rate if and only if $\bar{Y}=\sf 0$. This condition holds if the noise is additive, but appears to fail in general. (iv) The theory is illustrated with applications to gradient-free optimization and policy gradient algorithms for reinforcement learning.


title: Spatial distributions of Balmer series emissions in divertor plasmas with tungsten targets in different magnetic configurations on the EAST superconducting tokamak

abstract: The characteristics of wall recycling with different divertor configurations were investigated in this study, focusing on the observations of the spatial distributions of deuterium atomic emissions in the Balmer series (D_{\alpha}, D_{\beta}, D_{\gamma}, and D_{\delta}) with different magnetic field configurations in the Experimental Advanced Superconducting Tokamak. The observed D_{\alpha} and D_{\beta} emissions were primarily relatively close to the divertor targets, while the D_{\gamma} and D_{\delta} emissions were primarily relatively close to the X-point. The distributions of the emissions close to the divertor targets and X-point changed differently depending on the divertor configuration. These experimental results indicate that the linear comparison of parameters based on an assumption of similarity of profile shapes in different configurations is insufficient for understanding particle recycling in divertor plasmas. This is because the shape of the density profile of the recycled deuterium atoms and/or the electron density and temperature may change when the magnetic configuration is altered.


title: The Concept of Spin Ice Graphs and a Field Theory for their Topological Monopoles and Charges

abstract: Spin ices can now be fabricated in a variety of geometries which control their collective behavior and exotic properties. Therefore, their proper framework is graph theory. We relate spin ice notions such as ice rule, ice manifold, Coulomb phases, charges and monopoles, to graph-theoretical notions, such as balance, in/out-degrees, and Eulerianicity. We then propose a field-theoretical treatment in which topological charges and monopoles are the degrees of freedom while the binary spins are subsumed into entropic interaction among charges. We show that for a spin ice on a graph in a Gaussian approximation, the kernel of the entropic interaction is the inverse of the graph Laplacian, and we compute screening functions from the graph spectra as Green operators for the screened Poisson problem on a graph. We then apply the treatment on star graphs, tournaments, cycles, and regular spin ice in different dimensions.


title: Efficient, Decentralized, and Collaborative Multi-Robot Exploration using Optimal Transport Theory

abstract: An Optimal Transport (OT)-based decentralized collaborative multi-robot exploration strategy is proposed in this paper. This method is to achieve an efficient exploration with a predefined priority in the given domain. In this context, the efficiency indicates how a team of robots (agents) cover the domain reflecting the corresponding priority map (or degrees of importance) in the domain. The decentralized exploration implies that each agent carries out their exploration task independently in the absence of any supervisory agent/computer. When an agent encounters another agent within a communication range, each agent receives the information about which areas are already covered by other agents, yielding a collaborative exploration. The OT theory is employed to quantify the difference between the distribution formed by the robot trajectories and the given reference spatial distribution indicating the priority. A computationally feasible way is developed to measure the performance of the proposed exploration scheme. Further, the formal algorithm is provided for the efficient, decentralized, and collaborative exploration plan. Simulation results are presented to validate the proposed methods.


title: A task-based approach to parallel parametric linear programming solving, and application to polyhedral computations

abstract: Parametric linear programming is a central operation for polyhedral computations, as well as in certain control applications.Here we propose a task-based scheme for parallelizing it, with quasi-linear speedup over large problems.This type of parallel applications is challenging, because several tasks mightbe computing the same region. In this paper, we are presenting thealgorithm itself with a parallel redundancy elimination algorithm, andconducting a thorough performance analysis.


title: Online Convex Optimization in Changing Environments and its Application to Resource Allocation

abstract: In the era of the big data, we create and collect lots of data from all different kinds of sources: the Internet, the sensors, the consumer market, and so on. Many of the data are coming sequentially, and would like to be processed and understood quickly. One classic way of analyzing data is based on batch processing, in which the data is stored and analyzed in an offline fashion. However, when the volume of the data is too large, it is much more difficult and time-consuming to do batch processing than sequential processing. What's more, sequential data is usually changing dynamically, and needs to be understood on-the-fly in order to capture the changes. Online Convex Optimization (OCO) is a popular framework that matches the above sequential data processing requirement. Applications using OCO include online routing, online auctions, online classification and regression, as well as online resource allocation. Due to the general applicability of OCO to the sequential data and the rigorous theoretical guarantee, it has attracted lots of researchers to develop useful algorithms to fulfill different needs. In this thesis, we show our contributions to OCO's development by designing algorithms to adapt to changing environments.


title: On the Succinctness of Alternating Parity Good-for-Games Automata

abstract: We study alternating parity good-for-games (GFG) automata, i.e., alternating parity automata where both conjunctive and disjunctive choices can be resolved in an online manner, without knowledge of the suffix of the input word still to be read. We show that they can be exponentially more succinct than both their nondeterministic and universal counterparts. Furthermore, we present a single exponential determinisation procedure and an Exptime upper bound to the problem of recognising whether an alternating automaton is GFG. We also study the complexity of deciding "half-GFGness", a property specific to alternating automata that only requires nondeterministic choices to be resolved in an online manner. We show that this problem is PSpace-hard already for alternating automata on finite words.


title: Structure of $n$-quasi left $m$-invertible and related classes of operators

abstract: Given Hilbert space operators $T, S\in\B$, let $\triangle$ and $\delta\in B(\B)$ denote the elementary operators $\triangle_{T,S}(X)=(L_TR_S-I)(X)=TXS-X$ and $\delta_{T,S}(X)=(L_T-R_S)(X)=TX-XS$. Let $d=\triangle$ or $\delta$. Assuming $T$ commutes with $S^*$, and choosing $X$ to be the positive operator $S^{*n}S^n$ for some positive integer $n$, this paper exploits properties of elementary operators to study the structure of $n$-quasi $[m,d]$-operators $d^m_{T,S}(X)=0$ to bring together, and improve upon, extant results for a number of classes of operators, amongst them $n$-quasi left $m$-invertible operators, $n$-quasi $m$-isometric operators, $n$-quasi $m$-selfadjoint operators and $n$-quasi $(m,C)$ symmetric operators (for some conjugation $C$ of $\H$). It is proved that $S^n$ is the perturbation by a nilpotent of the direct sum of an operator $S_1^n=(S|_{\overline{S^n(\H)}})^n$ satisfying $d^m_{T_1,S_1}(I_1)=0$, $T_1=T|_{\overline{S^n(\H)}}$, with the $0$ operator; if also $S$ is left invertible, then $S^n$ is similar to an operator $B$ such that $d^m_{B^*,B}(I)=0$. For power bounded $S$ and $T$ such that $ST^*-T^*S=0$ and $\triangle_{T,S}(S^{*n}S^n)=0$, $S$ is polaroid (i.e., isolated points of the spectrum are poles). The product property, and the perturbation by a commuting nilpotent property, of operators $T, S$ satisfying $d^m_{T,S}(I)=0$, given certain commutativity properties, transfers to operators satisfying $S^{*n}d^m_{T,S}(I)S^n=0$.


title: Moment Generating Function of the AoI in a Two-Source System With Packet Management

abstract: We consider a status update system consisting of two independent sources and one server in which packets of each source are generated according to the Poisson process and packets are served according to an exponentially distributed service time. We derive the moment generating function (MGF) of the age of information (AoI) for each source in the system by using the stochastic hybrid systems (SHS) under two existing source-aware packet management policies which we term self-preemptive and non-preemptive policies. In the both policies, the system (i.e., the waiting queue and the server) can contain at most two packets, one packet of each source; when the server is busy and a new packet arrives, the possible packet of the same source in the waiting queue is replaced by the fresh packet. The main difference between the policies is that in the self-preemptive policy, the packet under service is replaced upon the arrival of a new packet from the same source, whereas in the non-preemptive policy, this new arriving packet is blocked and cleared. We use the derived MGF to find the first and second moments of the AoI and show the importance of higher moments.


title: Affect Expression Behaviour Analysis in the Wild using Spatio-Channel Attention and Complementary Context Information

abstract: Facial expression recognition(FER) in the wild is crucial for building reliable human-computer interactive systems. However, current FER systems fail to perform well under various natural and un-controlled conditions. This report presents attention based framework used in our submission to expression recognition track of the Affective Behaviour Analysis in-the-wild (ABAW) 2020 competition. Spatial-channel attention net(SCAN) is used to extract local and global attentive features without seeking any information from landmark detectors. SCAN is complemented by a complementary context information(CCI) branch which uses efficient channel attention(ECA) to enhance the relevance of features. The performance of the model is validated on challenging Aff-Wild2 dataset for categorical expression classification.


title: Spectral Embedding of Graph Networks

abstract: We introduce an unsupervised graph embedding that trades off local node similarity and connectivity, and global structure. The embedding is based on a generalized graph Laplacian, whose eigenvectors compactly capture both network structure and neighborhood proximity in a single representation. The key idea is to transform the given graph into one whose weights measure the centrality of an edge by the fraction of the number of shortest paths that pass through that edge, and employ its spectral proprieties in the representation. Testing the resulting graph network representation shows significant improvement over the sate of the art in data analysis tasks including social networks and material science. We also test our method on node classification from the human-SARS CoV-2 protein-protein interactome.


title: Square percolation and the threshold for quadratic divergence in random right-angled Coxeter groups

abstract: Given a graph $\Gamma$, its auxiliary \emph{square-graph} $\square(\Gamma)$ is the graph whose vertices are the non-edges of $\Gamma$ and whose edges are the pairs of non-edges which induce a square (i.e., a $4$-cycle) in $\Gamma$. We determine the threshold edge-probability $p=p_c(n)$ at which the Erd{\H o}s--R\'enyi random graph $\Gamma=\Gamma_{n,p}$ begins to asymptotically almost surely have a square-graph with a connected component whose squares together cover all the vertices of $\Gamma_{n,p}$. We show $p_c(n)=\sqrt{\sqrt{6}-2}/\sqrt{n}$, a polylogarithmic improvement on earlier bounds on $p_c(n)$ due to Hagen and the authors. As a corollary, we determine the threshold $p=p_c(n)$ at which the random right-angled Coxeter group $W_{\Gamma_{n,p}}$ asymptotically almost surely becomes strongly algebraically thick of order $1$ and has quadratic divergence.


title: Domain Control by Adjusting Anisotropic Stress in Pyrochlore Oxide Cd2Re2O7

abstract: The 5d pyrochlore oxide Cd2Re2O7 exhibits successive phase transitions from a cubic pyrochlore structure (phase I) to a tetragonal structure without inversion symmetry below Ts1 of ~200 K (phase II) and further to another noncentrosymmetric tetragonal structure below Ts2 of ~120 K (phase III). The two low-temperature phases may be characterized by odd-parity multipolar orders induced by the Fermi liquid instability of the spin-orbit-coupled metal. To control the tetragonal domains generated by the transitions and to obtain a single-domain crystal for the measurements of anisotropic properties, we prepared single crystals with the (0 0 1) surface and applied biaxial and uniaxial stresses along the plane. Polarizing optical microscopy observations revealed that inducing a small strain of approximately 0.05% could flip the twin domains ferroelastically in a reversible fashion at low temperatures, which evidences that the tetragonal deformation switches at Ts2 between c > a for phase II and c < a for phase III. Resistivity measurements using single-domain crystals under uniaxial stress showed that the anisotropy was maximum at around Ts2 and turned over across Ts2: resistivity along the c axis is larger (smaller) than that along the a axis by ~25% for phase II (III) at around Ts2. These large anisotropies probably originate from spin-dependent scattering in the spin-split Fermi surfaces of the cluster electric toroidal quadrupolar phases of Cd2Re2O7.


title: A law of robustness for two-layers neural networks

abstract: We initiate the study of the inherent tradeoffs between the size of a neural network and its robustness, as measured by its Lipschitz constant. We make a precise conjecture that, for any Lipschitz activation function and for most datasets, any two-layers neural network with $k$ neurons that perfectly fit the data must have its Lipschitz constant larger (up to a constant) than $\sqrt{n/k}$ where $n$ is the number of datapoints. In particular, this conjecture implies that overparametrization is necessary for robustness, since it means that one needs roughly one neuron per datapoint to ensure a $O(1)$-Lipschitz network, while mere data fitting of $d$-dimensional data requires only one neuron per $d$ datapoints. We prove a weaker version of this conjecture when the Lipschitz constant is replaced by an upper bound on it based on the spectral norm of the weight matrix. We also prove the conjecture in the high-dimensional regime $n \approx d$ (which we also refer to as the undercomplete case, since only $k \leq d$ is relevant here). Finally we prove the conjecture for polynomial activation functions of degree $p$ when $n \approx d^p$. We complement these findings with experimental evidence supporting the conjecture.


title: Towards Improved Model Design for Authorship Identification: A Survey on Writing Style Understanding

abstract: Authorship identification tasks, which rely heavily on linguistic styles, have always been an important part of Natural Language Understanding (NLU) research. While other tasks based on linguistic style understanding benefit from deep learning methods, these methods have not behaved as well as traditional machine learning methods in many authorship-based tasks. With these tasks becoming more and more challenging, however, traditional machine learning methods based on handcrafted feature sets are already approaching their performance limits. Thus, in order to inspire future applications of deep learning methods in authorship-based tasks in ways that benefit the extraction of stylistic features, we survey authorship-based tasks and other tasks related to writing style understanding. We first describe our survey results on the current state of research in both sets of tasks and summarize existing achievements and problems in authorship-related tasks. We then describe outstanding methods in style-related tasks in general and analyze how they are used in combination in the top-performing models. We are optimistic about the applicability of these models to authorship-based tasks and hope our survey will help advance research in this field.


title: Joint Mobility-Aware UAV Placement and Routing in Multi-Hop UAV Relaying Systems

abstract: Unmanned Aerial Vehicles (UAVs) have been extensively utilized to provide wireless connectivity in rural and under-developed areas, enhance network capacity and provide support for peaks or unexpected surges in user demand, mainly due to their fast deployment, cost-efficiency and superior communication performance resulting from Line of Sight (LoS)-dominated wireless channels. In order to exploit the benefits of UAVs as base stations or relays in a mobile network, a major challenge is to determine the optimal UAV placement and relocation strategy with respect to the mobility and traffic patterns of the ground network nodes. Moreover, considering that the UAVs form a multi-hop aerial network, capacity and connectivity constraints have significant impacts on the end-to-end network performance. To this end, we formulate the joint UAV placement and routing problem as a Mixed Integer Linear Program (MILP) and propose an approximation that leads to a LP rounding algorithm and achieves a balance between time-complexity and optimality.


title: Unramified cohomology, integral coniveau filtration and Griffiths group

abstract: We prove that the degree k unramified cohomology with torsion coefficients of a smooth complex projective variety X with small CH_0(X) has a filtration of length [k/2], whose first piece is the torsion part of the quotient of the degree k+1 integral singular cohomology by its coniveau 2 subgroup, and whose next graded piece is controlled by the Griffiths group Griff^{k/2+1}(X) when k is even and is related to the higher Chow group CH^{(k+3)/2}(X, 1) when k is odd. The first piece is a generalization of the Artin-Mumford invariant (k=2) and the Colliot-Thelene-Voisin invariant (k=3). We also give an analogous result for certain H-cohomology groups.


title: Ask-n-Learn: Active Learning via Reliable Gradient Representations for Image Classification

abstract: Deep predictive models rely on human supervision in the form of labeled training data. Obtaining large amounts of annotated training data can be expensive and time consuming, and this becomes a critical bottleneck while building such models in practice. In such scenarios, active learning (AL) strategies are used to achieve faster convergence in terms of labeling efforts. Existing active learning employ a variety of heuristics based on uncertainty and diversity to select query samples. Despite their wide-spread use, in practice, their performance is limited by a number of factors including non-calibrated uncertainties, insufficient trade-off between data exploration and exploitation, presence of confirmation bias etc. In order to address these challenges, we propose Ask-n-Learn, an active learning approach based on gradient embeddings obtained using the pesudo-labels estimated in each iteration of the algorithm. More importantly, we advocate the use of prediction calibration to obtain reliable gradient embeddings, and propose a data augmentation strategy to alleviate the effects of confirmation bias during pseudo-labeling. Through empirical studies on benchmark image classification tasks (CIFAR-10, SVHN, Fashion-MNIST, MNIST), we demonstrate significant improvements over state-of-the-art baselines, including the recently proposed BADGE algorithm.


title: Non-normal logics: semantic analysis and proof theory (extended version)

abstract: We introduce proper display calculi for basic monotonic modal logic, the conditional logic CK and a number of their axiomatic extensions. These calculi are sound, complete, conservative and enjoy cut elimination and subformula property. Our proposal applies the multi-type methodology in the design of proper display calculi, starting from a semantic analysis which motivates syntactic translations from single-type non-normal modal logics to multi-type normal poly-modal logics.


title: Numerical Predictive Control for Delay Compensation

abstract: We present a delay-compensating control method that transforms exponentially stabilizing controllers for an undelayed system into a sample-based predictive controller with numerical integration. Our method handles both first-order and transport delays in actuators and trades-off numerical accuracy with computation delay to guaranteed stability under hardware limitations. Through hybrid stability analysis and numerical simulation, we demonstrate the efficacy of our method from both theoretical and simulation perspectives.


title: Precise Half-Life Values for Two-Neutrino Double-$\beta$ Decay: 2020 review

abstract: All existing positive results on two-neutrino double beta decay and two-neutrino double electron capture in different nuclei have been analyzed. Weighted average and recommended half-life values for $^{48}$Ca, $^{76}$Ge, $^{82}$Se, $^{96}$Zr, $^{100}$Mo, $^{100}$Mo - $^{100}$Ru ($0^+_1$), $^{116}$Cd, $^{128}$Te, $^{130}$Te, $^{136}$Xe, $^{150}$Nd, $^{150}$Nd - $^{150}$Sm ($0^+_1$), $^{238}$U, $^{78}$Kr, $^{124}$Xe and $^{130}$Ba have been obtained. Given the measured half-life values, effective nuclear matrix elements for all these transitions were calculated.


title: Conformance Checking over Uncertain Event Data

abstract: The strong impulse to digitize processes and operations in companies and enterprises have resulted in the creation and automatic recording of an increasingly large amount of process data in information systems. These are made available in the form of event logs. Process mining techniques enable the process-centric analysis of data, including automatically discovering process models and checking if event data conform to a given model. In this paper, we analyze the previously unexplored setting of uncertain event logs. In such event logs uncertainty is recorded explicitly, i.e., the time, activity and case of an event may be unclear or imprecise. In this work, we define a taxonomy of uncertain event logs and models, and we examine the challenges that uncertainty poses on process discovery and conformance checking. Finally, we show how upper and lower bounds for conformance can be obtained by aligning an uncertain trace onto a regular process model.


title: Random data theory for the cubic fourth-order nonlinear Schr\"odinger equation

abstract: We consider the cubic nonlinear fourth-order Schr\"odinger equation \[ i\partial_t u - \Delta^2 u + \mu \Delta u = \pm |u|^2 u, \quad \mu \geq 0 \] on $\mathbb{R}^N, N \geq 5$ with random initial data. We prove almost sure local well-posedness below the scaling critical regularity. We also prove probabilistic small data global well-posedness and scattering. Finally, we prove the global well-posedness and scattering with a large probability for initial data randomized on dilated cubes.


title: Accurate and Robust Feature Importance Estimation under Distribution Shifts

abstract: With increasing reliance on the outcomes of black-box models in critical applications, post-hoc explainability tools that do not require access to the model internals are often used to enable humans understand and trust these models. In particular, we focus on the class of methods that can reveal the influence of input features on the predicted outputs. Despite their wide-spread adoption, existing methods are known to suffer from one or more of the following challenges: computational complexities, large uncertainties and most importantly, inability to handle real-world domain shifts. In this paper, we propose PRoFILE, a novel feature importance estimation method that addresses all these challenges. Through the use of a loss estimator jointly trained with the predictive model and a causal objective, PRoFILE can accurately estimate the feature importance scores even under complex distribution shifts, without any additional re-training. To this end, we also develop learning strategies for training the loss estimator, namely contrastive and dropout calibration, and find that it can effectively detect distribution shifts. Using empirical studies on several benchmark image and non-image data, we show significant improvements over state-of-the-art approaches, both in terms of fidelity and robustness.


title: Uncertainty-Matching Graph Neural Networks to Defend Against Poisoning Attacks

abstract: Graph Neural Networks (GNNs), a generalization of neural networks to graph-structured data, are often implemented using message passes between entities of a graph. While GNNs are effective for node classification, link prediction and graph classification, they are vulnerable to adversarial attacks, i.e., a small perturbation to the structure can lead to a non-trivial performance degradation. In this work, we propose Uncertainty Matching GNN (UM-GNN), that is aimed at improving the robustness of GNN models, particularly against poisoning attacks to the graph structure, by leveraging epistemic uncertainties from the message passing framework. More specifically, we propose to build a surrogate predictor that does not directly access the graph structure, but systematically extracts reliable knowledge from a standard GNN through a novel uncertainty-matching strategy. Interestingly, this uncoupling makes UM-GNN immune to evasion attacks by design, and achieves significantly improved robustness against poisoning attacks. Using empirical studies with standard benchmarks and a suite of global and target attacks, we demonstrate the effectiveness of UM-GNN, when compared to existing baselines including the state-of-the-art robust GCN.