title: Self-attention based anchor proposal for skeleton-based action recognition

abstract: Skeleton sequences are widely used for action recognition task due to its lightweight and compact characteristics. Recent graph convolutional network (GCN) approaches have achieved great success for skeleton-based action recognition since its grateful modeling ability of non-Euclidean data. GCN is able to utilize the short-range joint dependencies while lack to directly model the distant joints relations that are vital to distinguishing various actions. Thus, many GCN approaches try to employ hierarchical mechanism to aggregate wider-range neighborhood information. We propose a novel self-attention based skeleton-anchor proposal (SAP) module to comprehensively model the internal relations of a human body for motion feature learning. The proposed SAP module aims to explore inherent relationship within human body using a triplet representation via encoding high order angle information rather than the fixed pair-wise bone connection used in the existing hierarchical GCN approaches. A Self-attention based anchor selection method is designed in the proposed SAP module for extracting the root point of encoding angular information. By coupling proposed SAP module with popular spatial-temporal graph neural networks, e.g. MSG3D, it achieves new state-of-the-art accuracy on challenging benchmark datasets. Further ablation study have shown the effectiveness of our proposed SAP module, which is able to obviously improve the performance of many popular skeleton-based action recognition methods.


title: Disentangled representations: towards interpretation of sex determination from hip bone

abstract: By highlighting the regions of the input image that contribute the most to the decision, saliency maps have become a popular method to make neural networks interpretable. In medical imaging, they are particularly well-suited to explain neural networks in the context of abnormality localization. However, from our experiments, they are less suited to classification problems where the features that allow to distinguish between the different classes are spatially correlated, scattered and definitely non-trivial. In this paper we thus propose a new paradigm for better interpretability. To this end we provide the user with relevant and easily interpretable information so that he can form his own opinion. We use Disentangled Variational Auto-Encoders which latent representation is divided into two components: the non-interpretable part and the disentangled part. The latter accounts for the categorical variables explicitly representing the different classes of interest. In addition to providing the class of a given input sample, such a model offers the possibility to transform the sample from a given class to a sample of another class, by modifying the value of the categorical variables in the latent representation. This paves the way to easier interpretation of class differences. We illustrate the relevance of this approach in the context of automatic sex determination from hip bones in forensic medicine. The features encoded by the model, that distinguish the different classes were found to be consistent with expert knowledge.


title: Dynamics of phase defects trapped in optically imprinted orbits in dissipative binary polariton condensate

abstract: We study the dynamics of phase defects trapped in a finite optically imprinted ring lattice in binary polariton condensates, under the influence of the cross-interaction (CI) between the condensates in different spin components and the spin-orbit interaction (SOI). In this configuration, we find that a vortex circulates unidirectionally in optically induced orbits because of the Magnus force acting in the polariton fluid, and the vortex' angular velocity is influenced by the SOI and CI. Interestingly, in our system, these two interactions can also lead to elongated and frozen phase defects, forming a frozen dark solution with similarity to a dark soliton but with finite size in both spin components. When the dark solution is stretched further to occupy the entire orbit of a condensate ring, the phase defect triggers a snake instability and induces the decay of the dark ring solution. The circulation direction of a single vortex is determined by the Magnus force. This situation is more complex for the group motion of multiple vortices because of significant vortex-antivortex interaction. The collective motion of such vortex constellations, however, can be determined by the SOI.


title: Boolean valued semantics for infinitary logics

abstract: It is well known that the completeness theorem for $\mathrm{L}_{\omega_1\omega}$ fails with respect to Tarski semantics. Mansfield showed that it holds for $\mathrm{L}_{\infty\infty}$ if one replaces Tarski semantics with boolean valued semantics. We use forcing to improve his result in order to obtain a stronger form of boolean completeness (but only for $\mathrm{L}_{\infty\omega}$). Leveraging on our completeness result, we establish the Craig interpolation property and a strong version of the omitting types theorem for $\mathrm{L}_{\infty\omega}$ with respect to boolean valued semantics. We also show that a weak version of these results holds for $\mathrm{L}_{\infty\infty}$ (if one leverages instead on Mansfield's completeness theorem). Furthermore we bring to light (or in some cases just revive) several connections between the infinitary logic $\mathrm{L}_{\infty\omega}$ and the forcing method in set theory.


title: Concatenated Code Design for Constrained DNA Data Storage with Asymmetric Errors

abstract: DNA Data storage has recently attracted much attention due to its durable preservation and extremely high information density (bits per gram) properties. In this work, we propose a hybrid coding strategy comprising of generalized constrained codes to tackle homopolymer (run-length) limit and a protograph based low-density parity-check (LDPC) code to correct asymmetric nucleotide level (i.e., A/T/C/G) substitution errors that may occur in the process of DNA sequencing. Two sequencing techniques namely, Nanopore sequencer and Illumina sequencer with their equivalent channel models and capacities are analyzed. A coding architecture is proposed to potentially eliminate the catastrophic errors caused by the error-propagation in the constrained decoding while enabling high coding potential. We also show the log likelihood ratio (LLR) calculation method for the belief propagation decoding with this coding architecture. The simulation results and the theoretical analysis show that the proposed coding scheme exhibits good bit-error rate (BER) performance and high coding potential ($\sim1.98$ bits per nucleotide).


title: Audio Retrieval with Natural Language Queries: A Benchmark Study

abstract: The objectives of this work are cross-modal text-audio and audio-text retrieval, in which the goal is to retrieve the audio content from a pool of candidates that best matches a given written description and vice versa. Text-audio retrieval enables users to search large databases through an intuitive interface: they simply issue free-form natural language descriptions of the sound they would like to hear. To study the tasks of text-audio and audio-text retrieval, which have received limited attention in the existing literature, we introduce three challenging new benchmarks. We first construct text-audio and audio-text retrieval benchmarks from the AudioCaps and Clotho audio captioning datasets. Additionally, we introduce the SoundDescs benchmark, which consists of paired audio and natural language descriptions for a diverse collection of sounds that are complementary to those found in AudioCaps and Clotho. We employ these three benchmarks to establish baselines for cross-modal text-audio and audio-text retrieval, where we demonstrate the benefits of pre-training on diverse audio tasks. We hope that our benchmarks will inspire further research into audio retrieval with free-form text queries. Code, audio features for all datasets used, and the SoundDescs dataset are publicly available at https://github.com/akoepke/audio-retrieval-benchmark.


title: Role of the radiative stage for cosmic ray acceleration in SNRs

abstract: We consider diffusive shock acceleration in supernova remnants throughout their evolution including a radiative stage. It is found that a more efficient acceleration and fast exit of particles at the radiative stage results in the hardening of the source cosmic ray proton and electron spectra at energies $\sim 100-500$ GeV. The effect is stronger for cosmic ray electrons.


title: A random energy approach to deep learning

abstract: We study a generic ensemble of deep belief networks which is parametrized by the distribution of energy levels of the hidden states of each layer. We show that, within a random energy approach, statistical dependence can propagate from the visible to deep layers only if each layer is tuned close to the critical point during learning. As a consequence, efficiently trained learning machines are characterised by a broad distribution of energy levels. The analysis of Deep Belief Networks and Restricted Boltzmann Machines on different datasets confirms these conclusions.


title: Ultra-Highly Linear Magnetic Flux-to-Voltage response in Proximity-based Mesoscopic bi-SQUIDs

abstract: Superconducting double-loop interferometers (bi-SQUIDs) have been introduced to produce magnetic flux sensors specifically designed to exhibit ultra-highly linear voltage response as a function of the magnetic flux. These devices are very important for the quantum sensing and for signal processing of signals oscillating at the radio-frequencies range of the electromagnetic spectrum. Here, we report an Al double-loop bi-SQUIDs based on proximitized mesoscopic Cu Josephson junctions. Such a scheme provides an alternative fabrication approach to conventional tunnel junction-based interferometers, where the junction characteristics and, consequently, the magnetic flux-to-voltage and magnetic flux-to-critical current device response can be largely and easily tailored by the geometry of the metallic weak-links. We discuss the performance of such sensors by showing a full characterization of the device switching current and voltage drop \textit{vs.} magnetic flux for temperatures of operation ranging from 30 mK to $\sim 1$ K. The figure of merit of the transfer function and of the total harmonic distortion are also discussed. The latter provides an estimate of the linearity of the flux-to-voltage device response, which obtained values as large as 45 dB. Such a result let us foresee a performance already on pair with that achieved in conventional tunnel junction-based bi-SQUIDs arrays composed of hundreds of interferometers.


title: A Review on Visual Privacy Preservation Techniques for Active and Assisted Living

abstract: This paper reviews the state of the art in visual privacy protection techniques, with particular attention paid to techniques applicable to the field of active and assisted living (AAL). A novel taxonomy with which state-of-the-art visual privacy protection methods can be classified is introduced. Perceptual obfuscation methods, a category in the taxonomy, is highlighted. These are a category of visual privacy preservation techniques particularly relevant when considering scenarios that come under video-based AAL monitoring. Obfuscation against machine learning models is also explored. A high-level classification scheme of the different levels of privacy by design is connected to the proposed taxonomy of visual privacy preservation techniques. Finally, we note open questions that exist in the field and introduce the reader to some exciting avenues for future research in the area of visual privacy.


title: ActKnow: Active External Knowledge Infusion Learning for Question Answering in Low Data Regime

abstract: Deep learning models have set benchmark results in various Natural Language Processing tasks. However, these models require an enormous amount of training data, which is infeasible in many practical problems. While various techniques like domain adaptation, fewshot learning techniques address this problem, we introduce a new technique of actively infusing external knowledge into learning to solve low data regime problems. We propose a technique called ActKnow that actively infuses knowledge from Knowledge Graphs (KG) based "on-demand" into learning for Question Answering (QA). By infusing world knowledge from Concept-Net, we show significant improvements on the ARC Challenge-set benchmark over purely text-based transformer models like RoBERTa in the low data regime. For example, by using only 20% training examples, we demonstrate a 4% improvement in the accuracy for both ARC-challenge and OpenBookQA, respectively.


title: Search Strategy Formulation for Systematic Reviews: issues, challenges and opportunities

abstract: Systematic literature reviews play a vital role in identifying the best available evidence for health and social care policy. The resources required to produce systematic reviews can be significant, and a key to the success of any review is the search strategy used to identify relevant literature. However, the methods used to construct search strategies can be complex, time consuming, resource intensive and error prone. In this review, we examine the state of the art in resolving complex structured information needs, focusing primarily on the healthcare context. We analyse the literature to identify key challenges and issues and explore appropriate solutions and workarounds. From this analysis we propose a way forward to facilitate trust and transparency and to aid explainability, reproducibility and replicability through a set of key design principles for tools to support the development of search strategies in systematic literature reviews.


title: Knowledge graph enhanced recommender system

abstract: Knowledge Graphs (KGs) have shown great success in recommendation. This is attributed to the rich attribute information contained in KG to improve item and user representations as side information. However, existing knowledge-aware methods leverage attribute information at a coarse-grained level both in item and user side. In this paper, we proposed a novel attentive knowledge graph attribute network(AKGAN) to learn item attributes and user interests via attribute information in KG. Technically, AKGAN adopts a heterogeneous graph neural network framework, which has a different design between the first layer and the latter layer. With one attribute placed in the corresponding range of element-wise positions, AKGAN employs a novel interest-aware attention network, which releases the limitation that the sum of attention weight is 1, to model the complexity and personality of user interests towards attributes. Experimental results on three benchmark datasets show the effectiveness and explainability of AKGAN.


title: SiamTrans: Zero-Shot Multi-Frame Image Restoration with Pre-Trained Siamese Transformers

abstract: We propose a novel zero-shot multi-frame image restoration method for removing unwanted obstruction elements (such as rains, snow, and moire patterns) that vary in successive frames. It has three stages: transformer pre-training, zero-shot restoration, and hard patch refinement. Using the pre-trained transformers, our model is able to tell the motion difference between the true image information and the obstructing elements. For zero-shot image restoration, we design a novel model, termed SiamTrans, which is constructed by Siamese transformers, encoders, and decoders. Each transformer has a temporal attention layer and several self-attention layers, to capture both temporal and spatial information of multiple frames. Only pre-trained (self-supervised) on the denoising task, SiamTrans is tested on three different low-level vision tasks (deraining, demoireing, and desnowing). Compared with related methods, ours achieves the best performances, even outperforming those with supervised learning.


title: Continual Learning for Monolingual End-to-End Automatic Speech Recognition

abstract: Adapting Automatic Speech Recognition (ASR) models to new domains results in a deterioration of performance on the original domain(s), a phenomenon called Catastrophic Forgetting (CF). Even monolingual ASR models cannot be extended to new accents, dialects, topics, etc. without suffering from CF, making them unable to be continually enhanced without storing all past data. Fortunately, Continual Learning (CL) methods, which aim to enable continual adaptation while overcoming CF, can be used. In this paper, we implement an extensive number of CL methods for End-to-End ASR and test and compare their ability to extend a monolingual Hybrid CTC-Transformer model across four new tasks. We find that the best performing CL method closes the gap between the fine-tuned model (lower bound) and the model trained jointly on all tasks (upper bound) by more than 40%, while requiring access to only 0.6% of the original data.


title: Dynamics-aware Adversarial Attack of 3D Sparse Convolution Network

abstract: In this paper, we investigate the dynamics-aware adversarial attack problem in deep neural networks. Most existing adversarial attack algorithms are designed under a basic assumption -- the network architecture is fixed throughout the attack process. However, this assumption does not hold for many recently proposed networks, e.g. 3D sparse convolution network, which contains input-dependent execution to improve computational efficiency. It results in a serious issue of lagged gradient, making the learned attack at the current step ineffective due to the architecture changes afterward. To address this issue, we propose a Leaded Gradient Method (LGM) and show the significant effects of the lagged gradient. More specifically, we re-formulate the gradients to be aware of the potential dynamic changes of network architectures, so that the learned attack better "leads" the next step than the dynamics-unaware methods when network architecture changes dynamically. Extensive experiments on various datasets show that our LGM achieves impressive performance on semantic segmentation and classification. Compared with the dynamic-unaware methods, LGM achieves about 20% lower mIoU averagely on the ScanNet and S3DIS datasets. LGM also outperforms the recent point cloud attacks.


title: Federated Learning with Superquantile Aggregation for Heterogeneous Data

abstract: We present a federated learning framework that is designed to robustly deliver good predictive performance across individual clients with heterogeneous data. The proposed approach hinges upon a superquantile-based learning objective that captures the tail statistics of the error distribution over heterogeneous clients. We present a stochastic training algorithm that interleaves differentially private client filtering with federated averaging steps. We prove finite time convergence guarantees for the algorithm: $O(1/\sqrt{T})$ in the nonconvex case in $T$ communication rounds and $O(\exp(-T/\kappa^{3/2}) + \kappa/T)$ in the strongly convex case with local condition number $\kappa$. Experimental results on benchmark datasets for federated learning demonstrate that our approach is competitive with classical ones in terms of average error and outperforms them in terms of tail statistics of the error.


title: A classification of left-invariant pseudo-Riemannian metrics on some nilpotent Lie groups

abstract: It is known that a connected and simply-connected Lie group admits only one left-invariant Riemannian metric up to scaling and isometry if and only if it is isomorphic to the Euclidean space, the Lie group of the real hyperbolic space, or the direct product of the three dimensional Heisenberg group and the Euclidean space of dimension $n-3$. In this paper, we give a classification of left-invariant pseudo-Riemannian metrics of an arbitrary signature for the third Lie groups with $n \geq 4$ up to scaling and automorphisms. This completes the classifications of left-invariant pseudo-Riemannian metrics for the above three Lie groups up to scaling and automorphisms.


title: $n$-Kazhdan groups and higher spectral expanders

abstract: Let $\Gamma$ be a group of type $F_n$ and let $X$ be the $n$ skeleton of the universal cover of a $K(\Gamma,1)$ simplicial complex with finite $n$ skeleton. We show that if $\Gamma$ is strongly $n$-Kazhdan, then for any family of finite index subgroups $\{\Lambda_i\}_i$, the family of simplicial complexes $\{\Lambda_i\backslash X\}_i$ are bounded degree $n$-dimensional spectral expanders. Using this we construct new examples of $2$ dimensional spectral expanders.


title: A Review for Japanese auroral records on the three extreme space weather events around the International Geophysical Year (1957 -- 1958)

abstract: Solar Cycle 19 was probably the greatest solar cycle over the last four centuries and significantly disrupted the solar-terrestrial environments with a number of solar eruptions and resultant geomagnetic storms. At its peak, the International Geophysical Year (IGY: 1957 -- 1958) was organised by international collaborations and benefitted scientific developments, capturing multiple unique extreme space weather events including the third and fourth greatest geomagnetic storms in the space age. In this article, we review and analyse original records of Japanese auroral observations around the IGY. These observations were organised by Masaaki Huruhata in collaboration with professional observatories and citizen contributors. We have digitised and documented these source documents, which comprise significant auroral displays in March 1957 (minimum Dst = -255 nT), September 1957 (minimum Dst = -427 nT), and February 1958 (minimum Dst = -426 nT). These records allow us to visualise temporal and spatial evolutions of these auroral displays, reconstruct their equatorward auroral boundaries down to 41.4{\deg}, 38.3{\deg}, and 33.3{\deg} in invariant latitudes, and contextualise their occurrences following contemporary geomagnetic disturbances. Our results have been compared with significant auroral displays during other extreme space weather events. These aurorae generally showed reddish colourations occasionally with yellowish rays. Their colourations are attributed to reddish oxygen emission and its mixture with greenish oxygen emission. Overall, these archival records provide the references for future discussions on the auroral activities during the uniquely intense and extreme space weather events.


title: Forward rapidity J/$\psi$ production as a function of charged-particle multiplicity in pp collisions at $\sqrt{s} =$ 5.02 and 13 TeV

abstract: The production of J/$\psi$ is measured as a function of charged-particle multiplicity at forward rapidity in proton$-$proton (pp) collisions at center-of-mass energies $\sqrt{s} =$ 5.02 and 13 TeV. The J/$\psi$ mesons are reconstructed via their decay into dimuons in the rapidity interval (2.5 $< y <$ 4.0), whereas the charged-particle multiplicity density (${\rm d}N_{\rm{ch}}/{\rm d}\eta$) is measured at midrapidity $(|\eta| < 1)$. The production rate as a function of multiplicity is reported as the ratio of the yield in a given multiplicity interval to the multiplicity-integrated one. This observable shows a linear increase with charged-particle multiplicity normalized to the corresponding average value for inelastic events (${{\rm d}N_{\rm ch}/{\rm d}\eta}/{\langle {\rm d}N_{\rm ch}/{\rm d}\eta \rangle}$), at both the colliding energies. Measurements are compared with available ALICE results at midrapidity and theoretical model calculations. First measurement of the mean transverse momentum ($\langle p_{\mathrm{T}}\rangle$) of J/$\psi$ in pp collisions exhibits an increasing trend as a function of ${{\rm d}N_{\rm ch}/{\rm d}\eta}/{\langle {\rm d}N_{\rm ch}/{\rm d}\eta \rangle}$ showing a saturation towards high charged-particle multiplicities.


title: On the Lefschetz Property for quotients by monomial ideals containing squares of variables

abstract: Let $\Delta$ be an (abstract) simplicial complex on $n$ vertices. One can define the Artinian monomial algebra $A(\Delta) = \Bbbk[x_1, \ldots, x_n]/ \langle x_1^2, \ldots, x_n^2, I_{\Delta} \rangle$, where $\Bbbk$ is a field of characteristic $0$ and $I_\Delta$ is the Stanley-Reisner ideal associated to $\Delta$. In this paper, we aim to characterize the Weak Lefschetz Property (WLP) of $A(\Delta)$ in terms of the simplicial complex $\Delta$. We are able to completely analyze when WLP holds in degree $1$, complementing work by Migliore, Nagel and Schenck in [MNS2020]. We give a complete characterization of all $2$-dimensional pseudomanifolds $\Delta$ such that $A(\Delta)$ satisfies WLP. We also construct Artinian Gorenstein algebras that fail WLP by combining our results and the standard technique of Nagata idealization.


title: Product Information Browsing Support System Using Analytic Hierarchy Process

abstract: Large-scale e-commerce sites can collect and analyze a large number of user preferences and behaviors, and thus can recommend highly trusted products to users. However, it is very difficult for individuals or non-corporate groups to obtain large-scale user data. Therefore, we consider whether knowledge of the decision-making domain can be used to obtain user preferences and combine it with content-based filtering to design an information retrieval system. This study describes the process of building a product information browsing support system with high satisfaction based on product similarity and multiple other perspectives about products on the Internet. We present the architecture of the proposed system and explain the working principle of its constituent modules. Finally, we demonstrate the effectiveness of the proposed system through an evaluation experiment and a questionnaire.


title: Privacy preserving n-party scalar product protocol

abstract: Privacy-preserving machine learning enables the training of models on decentralized datasets without the need to reveal the data, both on horizontal and vertically partitioned data. However, it relies on specialized techniques and algorithms to perform the necessary computations. The privacy preserving scalar product protocol, which enables the dot product of vectors without revealing them, is one popular example for its versatility. Unfortunately, the solutions currently proposed in the literature focus mainly on two-party scenarios, even though scenarios with a higher number of data parties are becoming more relevant. For example when performing analyses that require counting the number of samples which fulfill certain criteria defined across various sites, such as calculating the information gain at a node in a decision tree. In this paper we propose a generalization of the protocol for an arbitrary number of parties, based on an existing two-party method. Our proposed solution relies on a recursive resolution of smaller scalar products. After describing our proposed method, we discuss potential scalability issues. Finally, we describe the privacy guarantees and identify any concerns, as well as comparing the proposed method to the original solution in this aspect.


title: Detectable Quantum Byzantine Agreement for Any Arbitrary Number of Dishonest Parties

abstract: Reaching agreement in the presence of arbitrary faults is a fundamental problem in distributed computation, which has been shown to be unsolvable if one-third of the processes can fail, unless signed messages are used. In this paper, we propose a solution to a variation of the original BA problem, called Detectable Byzantine Agreement (DBA), that does not need to use signed messages. The proposed algorithm uses what we call $Q$-correlated lists, which are generated by a quantum source device. Once each process has one of these lists, they use them to reach the agreement in a classical manner. Although, in general, the agreement is reached by using $m+1$ rounds (where $m$ is the number of processes that can fail), if less than one-third of the processes fail it only needs one round to reach the agreement.


title: ML Supported Predictions for SAT Solvers Performance

abstract: In order to classify the indeterministic termination behavior of the open source SAT solver CryptoMiniSat in multi-threading mode while processing hard to solve boolean satisfiability problem instances, internal solver runtime parameters have been collected and analyzed. A subset of these parameters has been selected and employed as features vector to successfully create a machine learning model for the binary classification of the solver's termination behavior with any single new solving run of a not yet solved instance. The model can be used for the early estimation of a solving attempt as belonging or not belonging to the class of candidates with good chances for a fast termination. In this context a combination of active profiles of runtime characteristics appear to mirror the influence of the solver's momentary heuristics on the immediate quality of the solver's resolution process. Because runtime parameters of already the first two solving iterations are enough to forecast termination of the attempt with good success scores, the results of the present work deliver a promising basis which can be further developed in order to enrich CryptoMiniSat or generally any modern SAT solver with AI abilities.


title: Matching Social Issues to Technologies for Civic Tech by Association Rule Mining using Weighted Casual Confidence

abstract: More than 80 civic tech communities in Japan are developing information technology (IT) systems to solve their regional issues. Collaboration among such communities across different regions assists in solving their problems because some groups have limited IT knowledge and experience for this purpose. Our objective is to realize a civic tech matchmaking system to assist such communities in finding better partners with IT experience in their issues. In this study, as the first step toward collaboration, we acquire relevant social issues and information technologies by association rule mining. To meet our challenge, we supply a questionnaire to members of civic tech communities and obtain answers on their faced issues and their available technologies. Subsequently, we match the relevant issues and technologies from the answers. However, most of the issues and technologies in this questionnaire data are infrequent, and there is a significant bias in their occurrence. Here, it is difficult to extract truly relevant issues--technologies combinations with existing interestingness measures. Therefore, we introduce a new measure called weighted casual confidence, and show that our measure is effective for mining relevant issues--technologies pairs.


title: A new upper bound for the Asymptotic Dimension of RACGs

abstract: Let $W_\Gamma$ be the Right-Angled Coxeter group with defining graph $\Gamma$. We show that the asymptotic dimension of $W_\Gamma$ is smaller than or equal to $dim_{CC}(\Gamma)$, the clique-connected dimension of the graph. As a corollary we show that $W_\Gamma$ is virtually free if and only if $dim_{CC}(\Gamma)=1$.


title: A dynamic program for linear sequential coding for Gaussian MAC with noisy feedback

abstract: In this paper consider a two user multiple access channel with noisy feedback. There are two senders with independent messages who transmit symbols across an additive white Gaussian channel to a receiver, who in turn sends back a symbol which is received by the two senders through two independent noisy Gaussian channels. We consider the case when the feedback is active i.e. the receiver actively encodes the feedback using a linear state process. We pose this as a problem of linear sequential coding at the senders and the receiver to minimize the terminal mean square probability of error at the receiver. This is an instance of decentralized control with no common information at the senders and the receiver. In this paper, we construct two linear controllers at the sender and the receiver. Due to linearity of the policies and the controllers, all the random variables involved are jointly Gaussian. Moreover, the corresponding covariance matrix at the receiver of the estimation process of the senders' messages is a deterministic process, which is a function of the parameters of the controllers and the strategies of the players, and is thus perfectly observed by the senders. Based on this observation, we use deterministic dynamic programming to find the optimal policies and the optimal linear controllers at both the senders and the receiver. The problem with passive feedback can be considered as a special case.


title: Adaptively Customizing Activation Functions for Various Layers

abstract: To enhance the nonlinearity of neural networks and increase their mapping abilities between the inputs and response variables, activation functions play a crucial role to model more complex relationships and patterns in the data. In this work, a novel methodology is proposed to adaptively customize activation functions only by adding very few parameters to the traditional activation functions such as Sigmoid, Tanh, and ReLU. To verify the effectiveness of the proposed methodology, some theoretical and experimental analysis on accelerating the convergence and improving the performance is presented, and a series of experiments are conducted based on various network models (such as AlexNet, VGGNet, GoogLeNet, ResNet and DenseNet), and various datasets (such as CIFAR10, CIFAR100, miniImageNet, PASCAL VOC and COCO) . To further verify the validity and suitability in various optimization strategies and usage scenarios, some comparison experiments are also implemented among different optimization strategies (such as SGD, Momentum, AdaGrad, AdaDelta and ADAM) and different recognition tasks like classification and detection. The results show that the proposed methodology is very simple but with significant performance in convergence speed, precision and generalization, and it can surpass other popular methods like ReLU and adaptive functions like Swish in almost all experiments in terms of overall performance.The code is publicly available at https://github.com/HuHaigen/Adaptively-Customizing-Activation-Functions. The package includes the proposed three adaptive activation functions for reproducibility purposes.


title: Distance Functions and Generalized Means: Duality and Taxonomy

abstract: This paper introduces in production theory a large class of efficiency measures that can be derived from the notion of utility function. This article also establishes a relation between these distance functions and Stone-Geary utility functions. More specifically, the paper focusses on new distance function that generalizes several existing efficiency measures. The new distance function is inspired from the Atkinson inequality index and maximizes the sum of the netput expansions required to reach an efficient point. A generalized duality theorem is proved and a duality result linking the new distance functions and the profit function is obtained. For all feasible production vectors, it includes as special cases most of the dual correspondences previously established in the literature. Finally, we identify a large class of measures for which these duality results can be obtained without convexity.


title: Non-topological logarithmic corrections in minimal gauged supergravity

abstract: We compute the logarithmic correction to the entropy of asymptotically AdS$_4$ black holes in minimal ${\cal N}=2$ gauged supergravity. We show that for extremal black holes the logarithmic correction computed in the near horizon geometry agrees with the result in the full geometry up to zero mode contributions, thus clarifying where the quantum degrees of freedom lie in AdS spacetimes. In contrast to flat space, we observe that the logarithmic correction for supersymmetric black holes can be non-topological in AdS as it is controlled by additional four-derivative terms other than the Euler density. The available microscopic data and results in 11d supergravity indicate that the full logarithmic correction is topological, which suggests that the topological nature of logarithmic corrections could serve as a diagnosis of whether a low-energy gravity theory admits an ultraviolet completion.


title: Data Efficient Language-supervised Zero-shot Recognition with Optimal Transport Distillation

abstract: Traditional computer vision models are trained to predict a fixed set of predefined categories. Recently, natural language has been shown to be a broader and richer source of supervision that provides finer descriptions to visual concepts than supervised "gold" labels. Previous works, such as CLIP, use InfoNCE loss to train a model to predict the pairing between images and text captions. CLIP, however, is data hungry and requires more than 400M image-text pairs for training. The inefficiency can be partially attributed to the fact that the image-text pairs are noisy. To address this, we propose OTTER (Optimal TransporT distillation for Efficient zero-shot Recognition), which uses online entropic optimal transport to find a soft image-text match as labels for contrastive learning. Based on pretrained image and text encoders, models trained with OTTER achieve strong performance with only 3M image text pairs. Compared with InfoNCE loss, label smoothing, and knowledge distillation, OTTER consistently outperforms these baselines in zero shot evaluation on Google Open Images (19,958 classes) and multi-labeled ImageNet 10K (10032 classes) from Tencent ML-Images. Over 42 evaluations on 7 different dataset/architecture settings x 6 metrics, OTTER outperforms (32) or ties (2) all baselines in 34 of them.


title: Microscopic origin of Einstein's field equations and the raison d'\^{e}tre for a positive cosmological constant

abstract: In the paradigm of effective field theory, one hierarchically obtains the effective action $\mathcal{A}_{\rm eff}[q, \cdots]$ for some low(er) energy degrees of freedom $q$, by integrating out the high(er) energy degrees of freedom $\xi$, in a path integral, based on an action $\mathcal{A}[q,\xi, \cdots]$. We show how one can integrate out a vector field $v^a$ in an action $\mathcal{A}[\Gamma,v,\cdots ]$ and obtain an effective action $\mathcal{A}_{\rm eff}[\Gamma, \cdots]$ which, on variation with respect to the connection $\Gamma$, leads to the Einstein's field equations and a metric compatible with the connection. The derivation \textit{predicts} a non-zero, positive, \cc, which arises as an integration constant. The Euclidean action $\mathcal{A}[\Gamma,v, \cdots]$, has an interpretation as the heat density of null surfaces, when translated into the Lorentzian spacetime. The vector field $v^a$ can be interpreted as the Euclidean analogue of the microscopic degrees of freedom hosted by any null surface. Several implications of this approach are discussed.


title: Sequential generation of multiphoton entanglement with a Rydberg superatom

abstract: Multiqubit entanglement is an indispensable resource for quantum information science. In particular, the entanglement of photons is of conceptual interest due to its implications in measurement-based quantum computing, communication, and metrology. The traditional way of spontaneous parametric down-conversion already demonstrates entanglement of up to a dozen photons but is hindered by its probabilistic nature. Here, we experimentally demonstrate an efficient approach for multi-photon generation with a Rydberg superatom, a mesoscopic atomic ensemble under Rydberg blockade. Using it as an efficient single-photon interface, we iterate the photon creation process that gives rise to a train of temporal photonic modes entangled in photon number degree. We detect the multiphoton entanglement via converting the photon number degree to a time-bin degree. Photon correlations verify entanglement up to 12 modes. The efficiency scaling factor for adding one photon is 0.27, surpassing previous results, and can be increased significantly without fundamental limitations.


title: Distillation of Human-Object Interaction Contexts for Action Recognition

abstract: Modeling spatial-temporal relations is imperative for recognizing human actions, especially when a human is interacting with objects, while multiple objects appear around the human differently over time. Most existing action recognition models focus on learning overall visual cues of a scene but disregard informative fine-grained features, which can be captured by learning human-object relationships and interactions. In this paper, we learn human-object relationships by exploiting the interaction of their local and global contexts. We hence propose the Global-Local Interaction Distillation Network (GLIDN), learning human and object interactions through space and time via knowledge distillation for fine-grained scene understanding. GLIDN encodes humans and objects into graph nodes and learns local and global relations via graph attention network. The local context graphs learn the relation between humans and objects at a frame level by capturing their co-occurrence at a specific time step. The global relation graph is constructed based on the video-level of human and object interactions, identifying their long-term relations throughout a video sequence. More importantly, we investigate how knowledge from these graphs can be distilled to their counterparts for improving human-object interaction (HOI) recognition. We evaluate our model by conducting comprehensive experiments on two datasets including Charades and CAD-120 datasets. We have achieved better results than the baselines and counterpart approaches.


title: Controlling coexisting attractors of a class of non-autonomous dynamical systems

abstract: This paper studies a control method for switching stable coexisting attractors of a class of non-autonomous dynamical systems. The central idea is to introduce a continuous path for the system's trajectory to transition from its original undesired stable attractor to a desired one by varying one of the system parameters according to the information of the desired attractor. The behaviour of the control is studied numerically for both non-smooth and smooth dynamical systems, using a sof-impact and a Duffing oscillator as examples. Special attention is given to identify the regions where the proposed control strategy is applicable by using the path-following methods implemented via the continuation platform COCO. It is shown that the proposed control concept can be implemented through either using an external control input or varying a system parameter. Finally, extensive numerical results are presented to validate the proposed control methods.


title: Decentralized Identifiers and Self-sovereign Identity in 6G

abstract: A key challenge for mobile network operators in 6G is to bring together and orchestrate a variety of new emerging players of today's mobile ecosystems in order to provide economically viable and seamless mobile connectivity in form of a multi-stakeholder service. With each new player, be it a cloud, edge or hardware provider, the need for interfaces with secure authentication and authorization mechanisms increases, as does the complexity and operational costs of the public key infrastructures required for the identity and key management. While today's centralized public key infrastructures have proven to be technically feasible in confined and trusted spaces, they do not provide the required security for access control once centralized identity providers must be avoided because of limited cross-domain interoperability, national data protection legislation, or geopolitical-strategic reasons. Recent decentralized identity management concepts, such as the W3C recommendation of Decentralized Identifiers, provide a secure, tamper-proof, and cross-domain identity management alternative for future multi-stakeholder 6G networks without relying on centralized identity provider or certification authorities. This article introduces the concept of Decentralized Identifiers together with the principles of Self-sovereign Identity and discusses opportunities and potential benefits of their application and usage for cross-domain and privacy-preserving identity and key management in 6G networks.


title: Alternative signatures of the quintuplet fermions at the LHC and future linear colliders

abstract: Large fermionic multiplets appear in different extensions of the Standard Model (SM), which are essential to predict small neutrino masses, relic abundance of the dark matter (DM) and the measured value of muon anomalous magnetic moment (muon (g-2)). Models containing quintuplet of fermions ($\Sigma$), along with other scalar multiplets, can address recent anomalies in the flavor sector while satisfying the constraints from the electroweak physics. In standard scenarios, the exotic fermions couple with the SM particles directly and there exists a strong limit on their masses from collider experiments such as the Large Hadron Collider (LHC). In this paper, we choose a particular scenario where the quintuplet fermions are heavier than the scalars, which is naturally motivated from the muon (g-2) data. A unique nature of these models is that they predict non-standard signatures at the colliders as the quintuplet fermions decay via the scalars once produced at the colliders. We study these non-standard interactions and provide alternative search strategies for these exotic fermions at the LHC and future linear colliders (such as $e^+e^-$ colliders). We also discuss their exclusion and discovery limits. For the doubly charged quintuplet fermion ($\Sigma^{\pm\pm}$), discovery is possible with 5$\sigma$ significance at integrated luminosity of 3000 fb$^{-1}$ at 14 TeV LHC if $M_\Sigma\leq 980$ GeV. For the singly charged quintuplet fermion ($\Sigma^\pm$), the discovery is challenging at LHC but there might be a possibility of 5 $\sigma$ discovery with 1000 fb$^{-1}$ luminosity at $e^+e^-$ collider for $M_\Sigma\leq 700$ GeV.


title: Geometry of the order-disorder surface of the mean-field square lattice Ising model with up to third-neighbor interactions

abstract: We revisit the field-free Ising model on a square lattice with up to third-neighbour (nnnn) interactions, also known as the $J_{1}$--$J_{2}$--$J_{3}$ model, in the mean-field approximation. Using a systematic enumeration procedure, we show that the region of phase space in which the high-temperature disordered phase is stable against all modes representing periodic magnetisation patterns up to a given size is a convex polytope that can be obtained by solving a standard vertex enumeration problem. Each face of this polytope corresponds to a set of coupling constants for which a single set of modes, equivalent up to a symmetry of the lattice, bifurcates from the disordered solution. While the structure of this polytope is simple in the halfspace $J_{3}>0$, where the nnnn-interaction is ferromagnetic, it becomes increasingly complex in the halfspace $J_{3}<0$, where the antiferromagnetic nnnn-interaction induces strong frustration. We characterize a few salient properties of these `disorder polytopes' in terms of the geometry of the space of contributing modes. We then consider the limit $N\rightarrow\infty$ giving a closed form description of the order-disorder surface in the thermodynamic limit, which shows that for $J_3 <0$ the emergent ordered phases will have a `devil's surface'-like mode structure. Finally, using Monte Carlo simulations, we show that for small periodic systems the mean-field analysis correctly predicts the dominant modes of the ordered phases that develop for coupling constants associated with the centroid of the faces of the disorder polytope.


title: Annulus graphs in $\mathbb R^d$

abstract: A $d$-dimensional annulus graph with radii $R_1$ and $R_2$ (here $R_2\ge R_1\ge 0$) is a graph embeddable in $\mathbb R^d$ so that two vertices $u$ and $v$ form an edge if and only if their images in the embedding are at distance in the interval $[R_1, R_2]$. In this paper we show that the family $\mathcal A_d(R_1,R_2)$ of $d$-dimensional annulus graphs with radii $R_1$ and $R_2$ is uniquely characterised by $R_2/R_1$ when this ratio is sufficiently large. Moreover, as a step towards a better understanding of the structure of $\mathcal A_d(R_1,R_2)$, we show that $\sup_{G\in \mathcal A_d(R_1,R_2)} \chi(G)/\omega(G)$ is given by $\exp(O(d))$ for all $R_1,R_2$ satisfying $R_2\ge R_1 > 0$ and also $\exp(\Omega(d))$ if moreover $R_2/R_1\ge 1.2$.


title: Zr Isotopes as a region of intertwined quantum phase transitions

abstract: The zirconium isotopes with $A=$ 92$-$110 have one of the most complicated evolution of structure in the nuclear chart. In order to understand the structural evolution of these isotopes, we carry a detailed calculation in a definite symmetry-based framework, the interacting boson model with configuration mixing (IBM-CM). We compare our calculation to a large range of experimental data, such as energy levels, two neutron separation energies, $E2$ and $E0$ transition rates, isotope shifts and magnetic moments. The structural evolution of the low lying spectra of these isotopes is explained using the notion of intertwined quantum phase transitions (IQPTs), for which a QPT involving a crossing of two configurations (Type II) is accompanied by a QPT involving a shape evolution of each configuration separately (Type I). In our study, we find the occurrence of Type I QPT within the intruder configuration, changing from weakly deformed to prolate deformed and finally to $\gamma$-unstable, associated with the U(5), SU(3) and SO(6) dynamical symmetry limits of the IBM, respectively. Alongside the Type I QPT, we also find the occurrence of Type II QPT between the normal and intruder configurations, where both Types I and II have a critical-point near $A\approx100$. The good agreement of our calculation with the vast empirical data along the chain of isotopes demonstrates the relevance of IQPTs to the zirconium isotopes, and can serve as a case study to set path for new investigations of IQPTs in other nuclei and other physical systems.


title: Enhanced mirror symmetry for Langlands dual Hitchin systems

abstract: The first part of this paper is a survey of mathematical results on mirror symmetry phenomena between Hitchin systems for Langlands dual groups. The second part introduces and discusses multiplicity algebras of the Hitchin system on Lagrangians, and considers corresponding conjectural structures on their mirror.


title: Compositional Learning-based Planning for Vision POMDPs

abstract: The Partially Observable Markov Decision Process (POMDP) is a powerful framework for capturing decision-making problems that involve state and transition uncertainty. However, most current POMDP planners cannot effectively handle high-dimensional image observations prevalent in real world applications, and often require lengthy online training that requires interaction with the environment. In this work, we propose Visual Tree Search (VTS), a compositional learning and planning procedure that combines generative models learned offline with online model-based POMDP planning. The deep generative observation models evaluate the likelihood of and predict future image observations in a Monte Carlo tree search planner. We show that VTS is robust to different types of image noises that were not present during training and can adapt to different reward structures without the need to re-train. This new approach significantly and stably outperforms several baseline state-of-the-art vision POMDP algorithms while using a fraction of the training time.


title: Quantum Computer Benchmarking via Quantum Algorithms

abstract: We present a framework that utilizes quantum algorithms, an architecture aware quantum noise model and an ideal simulator to benchmark quantum computers. The benchmark metrics highlight the difference between the quantum computer evolution and the simulated noisy and ideal quantum evolutions. We utilize our framework for benchmarking three IBMQ systems. The use of multiple algorithms, including continuous-time ones, as benchmarks stresses the computers in different ways highlighting their behaviour for a diverse set of circuits. The complexity of each quantum circuit affects the efficiency of each quantum computer, with increasing circuit size resulting in more noisy behaviour. Furthermore, the use of both a continuous-time quantum algorithm and the decomposition of its Hamiltonian also allows extracting valuable comparisons regarding the efficiency of the two methods on quantum systems. The results show that our benchmarks provide sufficient and well-rounded information regarding the performance of each quantum computer.


title: Quasistationary states in a quantum dot formed at the edge of a topological insulator by magnetic barriers with finite transparency

abstract: A model of quasistationary states is constructed for the one-dimensional edge states propagating along the edge of a two-dimensional topological insulator based on HgTe/CdTe quantum well in the presence of magnetic barriers with finite transparency. The lifetimes of these quasistationary states are found analytically and numerically via different approaches including the solution of the stationary Schroedinger equation with complex energy and the solution of the transmission problem for a double barrier structure. The results can serve as a guide for determining the parameters of magnetic barriers creating the quantum dots where the lifetimes for the broadened discrete levels are long enough for manipulation with their occupation numbers by external fields.


title: Weakly Supervised Semantic Segmentation via Alternative Self-Dual Teaching

abstract: Current weakly supervised semantic segmentation (WSSS) frameworks usually contain the separated mask-refinement model and the main semantic region mining model. These approaches would contain redundant feature extraction backbones and biased learning objectives, making them computational complex yet sub-optimal to addressing the WSSS task. To solve this problem, this paper establishes a compact learning framework that embeds the classification and mask-refinement components into a unified deep model. With the shared feature extraction backbone, our model is able to facilitate knowledge sharing between the two components while preserving a low computational complexity. To encourage high-quality knowledge interaction, we propose a novel alternative self-dual teaching (ASDT) mechanism. Unlike the conventional distillation strategy, the knowledge of the two teacher branches in our model is alternatively distilled to the student branch by a Pulse Width Modulation (PWM), which generates PW wave-like selection signal to guide the knowledge distillation process. In this way, the student branch can help prevent the model from falling into local minimum solutions caused by the imperfect knowledge provided of either teacher branch. Comprehensive experiments on the PASCAL VOC 2012 and COCO-Stuff 10K demonstrate the effectiveness of the proposed alternative self-dual teaching mechanism as well as the new state-of-the-art performance of our approach.


title: On effects of surface bipolar magnetic regions on the convection zone dynamo

abstract: We investigate the effect of the surface bipolar magnetic regions (BMR) on the large-scale dynamo distributed in the bulk of the convection zone. The study employs the nonlinear 3D mean-field dynamo model. We model the emergence of the BMR on the surface through the nonaxisymmetric magnetic buoyancy effect, which acts on the large-scale toroidal magnetic field in the upper half of the convection zone. The nonaxisymmetric magnetic field which results from this mechanism is shallow. On the surface, the effect of the BMR on the magnetic field generation is dominant. {However, because of the shallow BMR distribution, its effect on the global dynamo is less compared to the convective zone dynamo.} We find that the mean-field $\alpha$ effect, which acts on the nonaxisymmetric magnetic field of the BMRs, provides the greater contribution to the dynamo process than the BMR's tilt does. Even so, the fluctuations of the BMR's tilt lead to the parity braking in the global dynamo. At the surface the nonaxisymmetric magnetic field, which are generated because of the BMR's activity, shows a tendency for the bihelical spectrum with the positive sign for the low $\ell$ modes during the maximum of the magnetic activity cycle.


title: Two-level Method Part-scale Thermal Analysis of Laser Powder Bed Fusion Additive Manufacturing

abstract: Numerical simulations of a complete laser powder bed fusion (LPBF) additive manufacturing (AM) process are extremely challenging or even impossible to achieve without a radical model reduction of the complex physical phenomena occurring during the process. However, even when we adopt reduced model with simplified physics, the complex geometries of parts usually produced by LPBF AM processes make this kind of analysis computationally expensive. In fact, small geometrical features - which might be generated when the part is design following the principal of the so-called design for AM, for instance, by means of topology optimization procedures - often require complex conformal meshes. Immersed boundary methods seem to offer a valid alternative to deal with this kind of complexity. The two-level method lies within this family of numerical methods and presents a very flexible tool to deal with multi-scale problems. In this contribution, we apply the recently introduced two-level method to part-scale thermal analysis of LPBF manufactured components, first validating the proposed part-scale model with respect to experimental measurements from the literature and then applying the presented numerical framework to simulate a complete LPBF process of a topologically optimized structure, showing the capability of the method to easily deal with complex geometrical features.


title: Contrastive Explanations for Comparing Preferences of Reinforcement Learning Agents

abstract: In complex tasks where the reward function is not straightforward and consists of a set of objectives, multiple reinforcement learning (RL) policies that perform task adequately, but employ different strategies can be trained by adjusting the impact of individual objectives on reward function. Understanding the differences in strategies between policies is necessary to enable users to choose between offered policies, and can help developers understand different behaviors that emerge from various reward functions and training hyperparameters in RL systems. In this work we compare behavior of two policies trained on the same task, but with different preferences in objectives. We propose a method for distinguishing between differences in behavior that stem from different abilities from those that are a consequence of opposing preferences of two RL agents. Furthermore, we use only data on preference-based differences in order to generate contrasting explanations about agents' preferences. Finally, we test and evaluate our approach on an autonomous driving task and compare the behavior of a safety-oriented policy and one that prefers speed.


title: Chiral symmetry restoration with three chiral partners

abstract: I discuss the masses of chiral partners in the context of chiral symmetry restoration at finite temperature. Using the Nambu-Jona-Lasinio model I first remind the usual situation where two mesons of opposed parity become degenerate above the chiral transition temperature. Then I consider an effective theory for D mesons where the positive parity companion presents a "double pole structure". In this case three different masses need to be analyzed as functions of the temperature. I suggest a possible restoration pattern at high temperatures when the back-reaction of the quark condensate is incorporated.


title: Design aspects of Bi$_2$Sr$_2$CaCu$_2$O$_{8+\delta}$ THz sources: optimization of thermal and radiative properties

abstract: Impedance matching and heat management are important factors influencing performance of THz sources. In this work we analyze thermal and radiative properties of such devices based on mesa structures of a layered high-temperature superconductor Bi$_2$Sr$_2$CaCu$_2$O$_{8+\delta}$. Two types of devices are considered, containing either a conventional large single crystal, or a whisker. We perform numerical simulations for various geometrical configurations and parameters and make a comparison with experimental data for the two types of devices. It is demonstrated that the structure and the geometry of both the superconductor and the electrodes are playing important roles. In crystal-based devices an overlap between the crystal and the electrode leads to appearance of a large parasitic capacitance, which shunts THz emission and prevents impedance matching with open space. The overlap is avoided in whisker-based devices. Furthermore, the whisker and the electrodes form a turnstile (crossed-dipole) antenna facilitating good impedance matching. This leads to more than an order of magnitude enhancement of the radiation power efficiency in whisker-based, compared to crystal-based devices. These results are in good agreement with presented experimental data.


title: An adaptive splitting method for the Cox-Ingersoll-Ross process

abstract: We propose a new splitting method for strong numerical solution of the Cox-Ingersoll-Ross model. For this method, applied over both deterministic and adaptive random meshes, we prove a uniform moment bound and strong error results of order $1/4$ in $L_1$ and $L_2$ for the parameter regime $\kappa\theta>\sigma^2$. We then extend the new method to cover all parameter values by introducing a \emph{soft zero} region (where the deterministic flow determines the approximation) giving a hybrid type method to deal with the reflecting boundary. From numerical simulations we observe a rate of order $1$ when $\kappa\theta>\sigma^2$ rather than $1/4$. Asymptotically, for large noise, we observe that the rates of convergence decrease similarly to those of other schemes but that the proposed method making use of adaptive timestepping displays smaller error constants.


title: Fair Active Learning: Solving the Labeling Problem in Insurance

abstract: This paper addresses significant obstacles that arise from the widespread use of machine learning models in the insurance industry, with a specific focus on promoting fairness. The initial challenge lies in effectively leveraging unlabeled data in insurance while reducing the labeling effort and emphasizing data relevance through active learning techniques. The paper explores various active learning sampling methodologies and evaluates their impact on both synthetic and real insurance datasets. This analysis highlights the difficulty of achieving fair model inferences, as machine learning models may replicate biases and discrimination found in the underlying data. To tackle these interconnected challenges, the paper introduces an innovative fair active learning method. The proposed approach samples informative and fair instances, achieving a good balance between model predictive performance and fairness, as confirmed by numerical experiments on insurance datasets.


title: A Multimodal Approach for Automatic Mania Assessment in Bipolar Disorder

abstract: Bipolar disorder is a mental health disorder that causes mood swings that range from depression to mania. Diagnosis of bipolar disorder is usually done based on patient interviews, and reports obtained from the caregivers of the patients. Subsequently, the diagnosis depends on the experience of the expert, and it is possible to have confusions of the disorder with other mental disorders. Automated processes in the diagnosis of bipolar disorder can help providing quantitative indicators, and allow easier observations of the patients for longer periods. Furthermore, the need for remote treatment and diagnosis became especially important during the COVID-19 pandemic. In this thesis, we create a multimodal decision system based on recordings of the patient in acoustic, linguistic, and visual modalities. The system is trained on the Bipolar Disorder corpus. Comprehensive analysis of unimodal and multimodal systems, as well as various fusion techniques are performed. Besides processing entire patient sessions using unimodal features, a task-level investigation of the clips is studied. Using acoustic, linguistic, and visual features in a multimodal fusion system, we achieved a 64.8% unweighted average recall score, which improves the state-of-the-art performance achieved on this dataset.


title: Towards fuzzification of adaptation rules in self-adaptive architectures

abstract: In this paper, we focus on exploiting neural networks for the analysis and planning stage in self-adaptive architectures. The studied motivating cases in the paper involve existing (legacy) self-adaptive architectures and their adaptation logic, which has been specified by logical rules. We further assume that there is a need to endow these systems with the ability to learn based on examples of inputs and expected outputs. One simple option to address such a need is to replace the reasoning based on logical rules with a neural network. However, this step brings several problems that often create at least a temporary regress. The reason is the logical rules typically represent a large and tested body of domain knowledge, which may be lost if the logical rules are replaced by a neural network. Further, the black-box nature of generic neural networks obfuscates how the systems work inside and consequently introduces more uncertainty. In this paper, we present a method that makes it possible to endow an existing self-adaptive architectures with the ability to learn using neural networks, while preserving domain knowledge existing in the logical rules. We introduce a continuum between the existing rule-based system and a system based on a generic neural network. We show how to navigate in this continuum and create a neural network architecture that naturally embeds the original logical rules and how to gradually scale the learning potential of the network, thus controlling the uncertainty inherent to all soft computing models. We showcase and evaluate the approach on representative excerpts from two larger real-life use cases.


title: Nuclear transparency of the charged hadron produced in the inclusive electronuclear reaction

abstract: The nuclear transparency of the charged hadron produced in the inclusive $(e,e^\prime)$ reaction on the nucleus has been calculated using Glauber model for the nuclear reaction. The color transparency (CT) of the produced hadron and the short-range correlation (SRC) of the nucleons in the nucleus have been incorporated in the Glauber model to investigate their effects on the nuclear transparency of the hadron. The calculated nuclear transparencies for the proton and pion are compared with the data.


title: A Non-Linear Kalman Filter for track parameters estimation in High Energy Physics

abstract: The Kalman Filter is a widely used approach for the linear estimation of dynamical systems and is frequently employed within nuclear and particle physics experiments for the reconstruction of charged particle trajectories, known as tracks. Implementations of this formalism often make assumptions on the linearity of the underlying dynamic system and the Gaussian nature of the process noise, which is violated in many track reconstruction applications. This paper introduces an implementation of a Non-Linear Kalman Filter (NLKF) within the ACTS track reconstruction toolkit. The NLKF addresses the issue of non-linearity by using a set of representative sample points during its track state propagation. In a typical use case, the NLKF outperforms an Extended Kalman Filter in the accuracy and precision of the track parameter estimates obtained, with the increase in CPU time below a factor of two. It is therefore a promising approach for use in applications where precise estimation of track parameters is a key concern.


title: Applications of Nijenhuis geometry III: Frobenius pencils and compatible non-homogeneous Poisson structures

abstract: We consider multicomponent local Poisson structures of the form $\mathcal P_3 + \mathcal P_1$, under the assumption that the third order term $\mathcal P_3$ is Darboux-Poisson and non-degenerate, and study the Poisson compatibility of two such structures. We give an algebraic interpretation of this problem in terms of Frobenius algebras and reduce it to classification of Frobenius pencils, i.e. of linear families of Frobenius algebras. Then, we completely describe and classify Frobenius pencils under minor genericity conditions. In particular we show that each such Frobenuis pencil is a subpencil of a certain maximal pencil. These maximal pencils are uniquely determined by some combinatorial object, a directed rooted in-forest with edges labeled by numbers $\lambda_\alpha$'s and vertices labeled by natural numbers whose sum is the dimension of the manifold. These pencils are naturally related to certain (polynomial, in the most nondegenerate case) pencils of Nijenhuis operators. We show that common Frobenius coordinate systems admit an elegant invariant description in terms of the Nijenhuis pencil.


title: Multi-spacecraft observations of the structure of the sheath of an interplanetary coronal mass ejection and related energetic ion enhancement

abstract: Sheaths ahead of coronal mass ejections (CMEs) are large heliospheric structures that form with CME expansion and propagation. Turbulent and compressed sheaths contribute to the acceleration of particles in the corona and in interplanetary space, but the relation of their internal structures to particle energization is still relatively little studied. In particular, the role of sheaths in accelerating particles when the shock Mach number is low is a significant open problem. This work seeks to provide new insights on the internal structure of CME sheaths with regard to energetic particle enhancements. A good opportunity to achieve this aim was provided by observations of a sheath made by radially aligned spacecraft at 0.8 and $\sim$ 1 AU (Solar Orbiter, Wind, ACE and BepiColombo) on 19-21 April 2020. The sheath was preceded by a weak shock. Energetic ion enhancements occurred at different locations within the sheath structure at Solar Orbiter and L1. Magnetic fluctuation amplitudes at inertial-range scales increased in the sheath relative to the upstream wind. However, when normalised to the local mean field, fluctuation amplitudes did not increase significantly; magnetic compressibility of fluctuation also did not increase. Various substructures were embedded within the sheath at the different spacecraft, including multiple heliospheric current sheet (HCS) crossings and a small-scale flux rope. At L1, the ion flux enhancement was associated with the HCS crossings, while at Solar Orbiter, the enhancement occurred within the rope. Substructures that are swept from the upstream solar wind and compressed in the sheath can act as particularly effective acceleration sites. A possible acceleration mechanism is betatron acceleration associated with the small-scale flux rope and the warped HCS in the sheath.


title: Thermal freeze-out parameters and pseudo-entropy from charged hadron spectra in high energy collisions

abstract: We collected the transverse momentum (mass) spectra of charged hadrons ($\pi^{-}$, $\pi^{+}$, $K^{-}$, $K^{+}$, $\overline{p}$, and $p$) produced in collisions over a center-of-mass energy range from 2.70 to 200 GeV (per nucleon pair). The modified Tsallis--Pareto-type function (the TP-like function) with average transverse flow velocity is used to describe the contribution of participant or constituent quarks to transverse momentum of considered hadron. The experimental spectra of $\pi^{\mp}$ and $K^{\mp}$ (or $\overline{p}$ and $p$) are fitted by the convolution of two (or three) TP-like functions due to the fact that two (or three) constituent quarks are regarded as two (or three) energy resources in the formation of considered hadron. From the reasonable fits to the spectra, the thermal freeze-out parameters are extracted, and the pseudo-entropy is newly defined and extracted. Some parameters quickly change in the energy range of less than 7.7 GeV, and slowly change in the energy range of greater than 7.7 GeV, indicating the variation of collision mechanism at around 7.7 GeV.


title: Neutron star oscillations in pseudo-Newtonian gravity

abstract: We investigate the oscillations of neutron stars using a purely Newtonian approach and three other pseudo-Newtonian formulations. Our work is motivated by the fact that pseudo-Newtonian formulations are commonly used in core-collapse supernova (CCSN) simulations. We derive and solve numerically the radial and nonradial perturbation equations for neutron star oscillations using different combinations of modified Newtonian hydrodynamics equations and gravitational potentials. We pay special attention to the formulation proposed recently by Zha et al. [Phys. Rev. Lett. 125, 051102 (2020)] that implements the standard Case A effective potential in CCSN simulations with an additional lapse-function correction to the hydrodynamics equations. We find that this "Case A+lapse" formulation can typically approximate the frequency of the fundamental radial mode of a $1.4 M_\odot$ neutron star computed in general relativity to about a few tens of percent for our chosen EOS models. For the nonradial quadrupolar $f$ mode, which is expected to contribute strongly to the gravitational waves emitted from a protoneutron star, the Case A+lapse formulation performs much better and can approximate the $f$ mode frequency to within about a few percent even for the maximum-mass configuration in general relativity.


title: Relaxation of non-integrable systems and correlation functions

abstract: We investigate early-time equilibration rates of observables in closed many-body quantum systems and compare them to those of two correlation functions, first introduced by Kubo and Srednicki. We explore whether these different rates coincide at a universal value that sets the timescales of processes at a finite energy density. We find evidence for this coincidence when the initial conditions are sufficiently generic, or typical. We quantify this with the effective dimension of the state and with a state-observable effective dimension, which estimate the number of energy levels that participate in the dynamics. Our findings are confirmed by proving that these different timescales coincide for dynamics generated by Haar-random Hamiltonians. This also allows to quantitatively understand the scope of previous theoretical results on equilibration timescales and on random matrix formalisms. We approach this problem with exact, full spectrum diagonalization. The numerics are carried out in a non-integrable Heisenberg-like Hamiltonian, and the dynamics are investigated for several pairs of observables and states.


title: Probing New Physics at Future Tau Neutrino Telescopes

abstract: We systematically investigate new physics scenarios that can modify the interactions between neutrinos and matter at upcoming tau neutrino telescopes, which will test neutrino-proton collisions with energies $ \gtrsim 45~{\rm TeV}$, and can provide unique insights to the elusive tau neutrino. At such high energy scales, the impact of parton distribution functions of second and third generations of quarks (usually suppressed) can be comparable to the contribution of first generation with small momentum fraction, hence making tau neutrino telescopes an excellent facility to probe new physics associated with second and third families. Among an inclusive set of particle physics models, we identify new physics scenarios at tree level that can give competitive contributions to the neutrino cross sections while staying within laboratory constraints: charged/neutral Higgs and leptoquarks. Our analysis is close to the actual experimental configurations of the telescopes, and we perform a $\chi^2$-analysis on the energy and angular distributions of the tau events. By numerically solving the propagation equations of neutrino and tau fluxes in matter, we obtain the sensitivities of representative upcoming tau neutrino telescopes, GRAND, POEMMA and Trinity, to the charged Higgs and leptoquark models. While each of the experiments can achieve a sensitivity better than the current collider reaches for certain models, their combination is remarkably complementary in probing the new physics. In particular, the new physics will affect the energy and angular distributions in different ways at those telescopes.


title: Learning Reward Machines: A Study in Partially Observable Reinforcement Learning

abstract: Reinforcement learning (RL) is a central problem in artificial intelligence. This problem consists of defining artificial agents that can learn optimal behaviour by interacting with an environment -- where the optimal behaviour is defined with respect to a reward signal that the agent seeks to maximize. Reward machines (RMs) provide a structured, automata-based representation of a reward function that enables an RL agent to decompose an RL problem into structured subproblems that can be efficiently learned via off-policy learning. Here we show that RMs can be learned from experience, instead of being specified by the user, and that the resulting problem decomposition can be used to effectively solve partially observable RL problems. We pose the task of learning RMs as a discrete optimization problem where the objective is to find an RM that decomposes the problem into a set of subproblems such that the combination of their optimal memoryless policies is an optimal policy for the original problem. We show the effectiveness of this approach on three partially observable domains, where it significantly outperforms A3C, PPO, and ACER, and discuss its advantages, limitations, and broader potential.


title: Free-Riding for Future: Field Experimental Evidence of Strategic Substitutability in Climate Protest

abstract: We test the hypothesis that protest participation decisions in an adult population of potential climate protesters are interdependent. Subjects (n=1,510) from the four largest German cities were recruited two weeks before protest date. We measured participation (ex post) and beliefs about the other subjects' participation (ex ante) in an online survey, used a randomized informational intervention to induce exogenous variance in beliefs, and estimated the causal effect of a change in belief on the probability of participation using a control function approach. Participation decisions are found to be strategic substitutes: a one percentage-point increase of belief causes a .67 percentage-point decrease in the probability of participation in the average subject.


title: Towards a Complexity Classification of LCL Problems in Massively Parallel Computation

abstract: In this work, we develop the low-space Massively Parallel Computation (MPC) complexity landscape for a family of fundamental graph problems on trees. We present a general method that solves most locally checkable labeling (LCL) problems exponentially faster in the low-space MPC model than in the LOCAL message passing model. In particular, we show that all solvable LCL problems on trees can be solved in $O(\log n)$ time (high-complexity regime) and that all LCL problems on trees with deterministic complexity $n^{o(1)}$ in the LOCAL model can be solved in $O(\log \log n)$ time (mid-complexity regime). We observe that obtaining a greater speed-up than from $n^{o(1)}$ to $\Theta(\log \log n)$ is conditionally impossible, since the problem of 3-coloring trees, which is a LCL problem with LOCAL time complexity $n^{o(1)}$, has a conditional MPC lower bound of $\Omega(\log \log n)$ [Linial, FOCS'87; Ghaffari, Kuhn and Uitto, FOCS'19]. We emphasize that we solve LCL problems on constant-degree trees, and that our algorithms are deterministic, component-stable, and work in the low-space MPC model, where local memory is $O(n^\delta)$ for $\delta \in (0,1)$ and global memory is $O(m)$. For the high-complexity regime, there are two key ingredients. One is a novel $O(\log n)$-time tree rooting algorithm, which may be of independent interest. The other is a novel pointer-chain technique and analysis that allows us to solve any solvable LCL problem on trees in $O(\log n)$ time. For the mid-complexity regime, we adapt the approach by Chang and Pettie [FOCS'17], who gave a canonical LOCAL algorithm for solving LCL problems on trees.


title: A Psh Hopf Lemma for Domains with Cusp Conditions

abstract: We obtain a psh Hopf lemma for domains satisfying certain cusp conditions by using a sharp estimate for the Green function of a planar cusp along the axis. As an application, we obtain a negative psh exhaustion function with certain global growth estimate on a pseudoconvex domain with H\"{o}lder boundary.


title: Congruences like Atkin's for the partition function

abstract: Let $p(n)$ be the ordinary partition function. In the 1960s Atkin found a number of examples of congruences of the form $p( Q^3 \ell n+\beta)\equiv0\pmod\ell$ where $\ell$ and $Q$ are prime and $5\leq \ell\leq 31$; these lie in two natural families distinguished by the square class of $1-24\beta\pmod\ell$. In recent decades much work has been done to understand congruences of the form $p(Q^m\ell n+\beta)\equiv 0\pmod\ell$. It is now known that there are many such congruences when $m\geq 4$, that such congruences are scarce (if they exist at all) when $m=1, 2$, and that for $m=0$ such congruences exist only when $\ell=5, 7, 11$. For congruences like Atkin's (when $m=3$), more examples have been found for $5\leq \ell\leq 31$ but little else seems to be known. Here we use the theory of modular Galois representations to prove that for every prime $\ell\geq 5$, there are infinitely many congruences like Atkin's in the first natural family which he discovered and that for at least $17/24$ of the primes $\ell$ there are infinitely many congruences in the second family.


title: Neutral to charged kaon yield fluctuations in Pb$-$Pb collisions at $\sqrt{s_{\rm NN}}$ = 2.76TeV

abstract: We present the first measurement of event-by-event fluctuations in the kaon sector in Pb-Pb collisions at $\sqrt {s_{\rm NN}}=$ 2.76 TeV with the ALICE detector at the LHC. The robust fluctuation correlator $\nu_{\rm dyn}$ is used to evaluate the magnitude of fluctuations of the relative yields of neutral and charged kaons, as well as the relative yields of charged kaons, as a function of collision centrality and selected kinematic ranges. While the correlator $\nu_{\rm dyn}[\rm K^+,\rm K^-]$ exhibits a scaling approximately in inverse proportion of the charged particle multiplicity, $\nu_{\rm dyn}[\rm K_S^0,\rm K^{\pm}]$ features a significant deviation from such scaling. Within uncertainties, the value of $\nu_{\rm dyn}[\rm K_S^0,\rm K^{\pm}]$ is independent of the selected transverse momentum interval, while it exhibits a pseudorapidity dependence. The results are compared with HIJING, AMPT and EPOS-LHC predictions, and are further discussed in the context of the possible production of disoriented chiral condensates in central Pb-Pb collisions.


title: Learning from Heterogeneous Data Based on Social Interactions over Graphs

abstract: This work proposes a decentralized architecture, where individual agents aim at solving a classification problem while observing streaming features of different dimensions and arising from possibly different distributions. In the context of social learning, several useful strategies have been developed, which solve decision making problems through local cooperation across distributed agents and allow them to learn from streaming data. However, traditional social learning strategies rely on the fundamental assumption that each agent has significant prior knowledge of the underlying distribution of the observations. In this work we overcome this issue by introducing a machine learning framework that exploits social interactions over a graph, leading to a fully data-driven solution to the distributed classification problem. In the proposed social machine learning (SML) strategy, two phases are present: in the training phase, classifiers are independently trained to generate a belief over a set of hypotheses using a finite number of training samples; in the prediction phase, classifiers evaluate streaming unlabeled observations and share their instantaneous beliefs with neighboring classifiers. We show that the SML strategy enables the agents to learn consistently under this highly-heterogeneous setting and allows the network to continue learning even during the prediction phase when it is deciding on unlabeled samples. The prediction decisions are used to continually improve performance thereafter in a manner that is markedly different from most existing static classification schemes where, following training, the decisions on unlabeled data are not re-used to improve future performance.


title: Learning in Restless Bandits under Exogenous Global Markov Process

abstract: We consider an extension to the restless multi-armed bandit (RMAB) problem with unknown arm dynamics, where an unknown exogenous global Markov process governs the rewards distribution of each arm. Under each global state, the rewards process of each arm evolves according to an unknown Markovian rule, which is non-identical among different arms. At each time, a player chooses an arm out of $N$ arms to play, and receives a random reward from a finite set of reward states. The arms are restless, that is, their local state evolves regardless of the player's actions. Motivated by recent studies on related RMAB settings, the regret is defined as the reward loss with respect to a player that knows the dynamics of the problem, and plays at each time $t$ the arm that maximizes the expected immediate value. The objective is to develop an arm-selection policy that minimizes the regret. To that end, we develop the Learning under Exogenous Markov Process (LEMP) algorithm. We analyze LEMP theoretically and establish a finite-sample bound on the regret. We show that LEMP achieves a logarithmic regret order with time. We further analyze LEMP numerically and present simulation results that support the theoretical findings and demonstrate that LEMP significantly outperforms alternative algorithms.


title: Anisotropic Besov regularity of parabolic PDEs

abstract: This paper is concerned with the regularity of solutions to parabolic evolution equations. Special attention is paid to the smoothness in the specific anisotropic scale $\ B^{r\mathbf{a}}_{\tau,\tau}, \ \frac{1}{\tau}=\frac{r}{d}+\frac{1}{p}\ $ of Besov spaces where $\mathbf{a}$ measures the anisotropy. The regularity in these spaces determines the approximation order that can be achieved by fully space-time adaptive approximation schemes. In particular, we show that for the heat equation our results significantly improve previous results by Aimar and Gomez [3].


title: Stochastic solutions for time-fractional heat equations with complex spatial variables

abstract: We deal with complex spatial diffusion equations with time-fractional derivative and study their stochastic solutions. In particular, we complexify the integral operator solution to the heat-type equation where the time derivative is replaced with the convolution-type generalization of the regularized Caputo derivative. We prove that this operator is solution of a complex time-fractional heat equation with complex spatial variable. This approach leads to a wrapped Brownian motion on a circle time-changed by the inverse of the related subordinator. This time-changed Brownian motion is analyzed and, in particular, some results on its moments, as well as its construction as weak limit of continuous-time random walks, are obtained. The extension of our approach to the higher dimensional case is also provided.


title: A controller for reaching and unveiling a partially occluded object of interest with an eye-in-hand robot

abstract: In this work, a control scheme for approaching and unveiling a partially occluded object of interest is proposed.The control scheme is based only on the classified point cloud obtained by the in-hand camera attached to the robot's end effector. It is shown that the proposed controller reaches in the vicinity of the object progressively unveiling the neighborhood of each visible point of the object of interest. It can therefore potentially achieve the complete unveiling of the object. The proposed control scheme is evaluated through simulations and experiments with a UR5e robot with an in-hand RealSense camera on a mock-up vine setup for unveiling the stem of a grape.


title: Joint Chinese Word Segmentation and Part-of-speech Tagging via Two-stage Span Labeling

abstract: Chinese word segmentation and part-of-speech tagging are necessary tasks in terms of computational linguistics and application of natural language processing. Many re-searchers still debate the demand for Chinese word segmentation and part-of-speech tagging in the deep learning era. Nevertheless, resolving ambiguities and detecting unknown words are challenging problems in this field. Previous studies on joint Chinese word segmentation and part-of-speech tagging mainly follow the character-based tagging model focusing on modeling n-gram features. Unlike previous works, we propose a neural model named SpanSegTag for joint Chinese word segmentation and part-of-speech tagging following the span labeling in which the probability of each n-gram being the word and the part-of-speech tag is the main problem. We use the biaffine operation over the left and right boundary representations of consecutive characters to model the n-grams. Our experiments show that our BERT-based model SpanSegTag achieved competitive performances on the CTB5, CTB6, and UD, or significant improvements on CTB7 and CTB9 benchmark datasets compared with the current state-of-the-art method using BERT or ZEN encoders.


title: A Belief Propagation Solution for Beam Coordination in MmWave Vehicular Networks

abstract: Millimeter-wave communication is widely seen as a promising option to increase the capacity of vehicular networks, where it is expected that connected cars will soon need to transmit and receive large amounts of data. Due to harsh propagation conditions, mmWave systems resort to narrow beams to serve their users, and such beams need to be configured according to traffic demand and its spatial distribution, as well as interference. In this work, we address the beam management problem, considering an urban vehicular network composed of gNBs. We first build an accurate, yet tractable, system model and formulate an optimization problem aiming at maximizing the total network data rate while accounting for the stochastic nature of the network scenario. Then we develop a graph-based model capturing the main system characteristics and use it to develop a belief propagation algorithmic framework, called CRAB, that has low complexity and, hence, can effectively cope with large-scale scenarios. We assess the performance of our approach under real-world settings and show that, in comparison to state-of-the-art alternatives, CRAB provides on average a 50% improvement in the amount of data transferred by the single gNBs and up to 30% better user coverage.


title: Visual Microfossil Identification via Deep Metric Learning

abstract: We apply deep metric learning for the first time to the problem of classifying planktic foraminifer shells on microscopic images. This species recognition task is an important information source and scientific pillar for reconstructing past climates. All foraminifer CNN recognition pipelines in the literature produce black-box classifiers that lack visualization options for human experts and cannot be applied to open-set problems. Here, we benchmark metric learning against these pipelines, produce the first scientific visualization of the phenotypic planktic foraminifer morphology space, and demonstrate that metric learning can be used to cluster species unseen during training. We show that metric learning outperforms all published CNN-based state-of-the-art benchmarks in this domain. We evaluate our approach on the 34,640 expert-annotated images of the Endless Forams public library of 35 modern planktic foraminifera species. Our results on this data show leading 92% accuracy (at 0.84 F1-score) in reproducing expert labels on withheld test data, and 66.5% accuracy (at 0.70 F1-score) when clustering species never encountered in training. We conclude that metric learning is highly effective for this domain and serves as an important tool towards expert-in-the-loop automation of microfossil identification. Keycode, network weights, and data splits are published with this paper for full reproducibility.


title: Topological boundaries of covariant representations

abstract: We associate a boundary $\mathcal B_{\pi,u}$ to each covariant representation $(\pi,u,H)$ of $C^*$-dynamical system $(G,A,\alpha)$ and study the action of $G$ on $\mathcal B_{\pi,u}$ and its amenability properties. We relate rigidity properties of traces on the associated crossed product C*-algebra to faithfulness of action of the group on this boundary.


title: Collision-sticking kinetics of acid-base clusters and its influence on atmospheric new particle formation

abstract: Kinetics of collision-sticking processes between vapor molecules and molecular clusters of low volatile compounds facilitates the initial steps of atmospheric clustering. Conventional theoretical models are quite inaccurate due to the neglection of long-range interactions that essentially govern the kinetics of these microscopic phenomena. Here, we present a consistent and generic theoretical model for evaluating collision rates between molecules and molecular clusters with intermolecular potentials properly incorporated. The model requires solely the elementary molecule-molecule potential as a-priori information but predicts collision rates of molecular clusters at arbitrary sizes, with an accuracy comparable to all-atom molecular dynamics simulations we performed for sulfuric acid-dimethylamine clusters, a typical example of acid-base induced clustering. The carefully devised simulations validate the theoretical model and elucidate the kinetics of the molecular collision-sticking process. It is found that the vibrational coupling after the collision between a sulfuric acid molecule and a sulfuric acid cluster can be occasionally unsuccessful, i.e., no stable bond is formed after the collision. However, introducing dimethylamine molecules to the sulfuric acid cluster can notably increase the probability of forming stable bonds and hence stable product clusters. The results offer fundamental insights into the initial steps of molecular clustering and will facilitate the development of efficient kinetic approach-based nucleation models.


title: Methods for segmenting cracks in 3d images of concrete: A comparison based on semi-synthetic images

abstract: Concrete is the standard construction material for buildings, bridges, and roads. As safety plays a central role in the design, monitoring, and maintenance of such constructions, it is important to understand the cracking behavior of concrete. Computed tomography captures the microstructure of building materials and allows to study crack initiation and propagation. Manual segmentation of crack surfaces in large 3d images is not feasible. In this paper, automatic crack segmentation methods for 3d images are reviewed and compared. Classical image processing methods (edge detection filters, template matching, minimal path and region growing algorithms) and learning methods (convolutional neural networks, random forests) are considered and tested on semi-synthetic 3d images. Their performance strongly depends on parameter selection which should be adapted to the grayvalue distribution of the images and the geometric properties of the concrete. In general, the learning methods perform best, in particular for thin cracks and low grayvalue contrast.


title: Dialog+ in Broadcasting: First Field Tests Using Deep-Learning-Based Dialogue Enhancement

abstract: Difficulties in following speech due to loud background sounds are common in broadcasting. Object-based audio, e.g., MPEG-H Audio solves this problem by providing a user-adjustable speech level. While object-based audio is gaining momentum, transitioning to it requires time and effort. Also, lots of content exists, produced and archived outside the object-based workflows. To address this, Fraunhofer IIS has developed a deep-learning solution called Dialog+, capable of enabling speech level personalization also for content with only the final audio tracks available. This paper reports on public field tests evaluating Dialog+, conducted together with Westdeutscher Rundfunk (WDR) and Bayerischer Rundfunk (BR), starting from September 2020. To our knowledge, these are the first large-scale tests of this kind. As part of one of these, a survey with more than 2,000 participants showed that 90% of the people above 60 years old have problems in understanding speech in TV "often" or "very often". Overall, 83% of the participants liked the possibility to switch to Dialog+, including those who do not normally struggle with speech intelligibility. Dialog+ introduces a clear benefit for the audience, filling the gap between object-based broadcasting and traditionally produced material.