title: Whose Emotion Matters? Speaking Activity Localisation without Prior Knowledge

abstract: The task of emotion recognition in conversations (ERC) benefits from the availability of multiple modalities, as provided, for example, in the video-based Multimodal EmotionLines Dataset (MELD). However, only a few research approaches use both acoustic and visual information from the MELD videos. There are two reasons for this: First, label-to-video alignments in MELD are noisy, making those videos an unreliable source of emotional speech data. Second, conversations can involve several people in the same scene, which requires the localisation of the utterance source. In this paper, we introduce MELD with Fixed Audiovisual Information via Realignment (MELD-FAIR) by using recent active speaker detection and automatic speech recognition models, we are able to realign the videos of MELD and capture the facial expressions from speakers in 96.92% of the utterances provided in MELD. Experiments with a self-supervised voice recognition model indicate that the realigned MELD-FAIR videos more closely match the transcribed utterances given in the MELD dataset. Finally, we devise a model for emotion recognition in conversations trained on the realigned MELD-FAIR videos, which outperforms state-of-the-art models for ERC based on vision alone. This indicates that localising the source of speaking activities is indeed effective for extracting facial expressions from the uttering speakers and that faces provide more informative visual cues than the visual features state-of-the-art models have been using so far. The MELD-FAIR realignment data, and the code of the realignment procedure and of the emotional recognition, are available at https://github.com/knowledgetechnologyuhh/MELD-FAIR.


title: Aesthetically Relevant Image Captioning

abstract: Image aesthetic quality assessment (AQA) aims to assign numerical aesthetic ratings to images whilst image aesthetic captioning (IAC) aims to generate textual descriptions of the aesthetic aspects of images. In this paper, we study image AQA and IAC together and present a new IAC method termed Aesthetically Relevant Image Captioning (ARIC). Based on the observation that most textual comments of an image are about objects and their interactions rather than aspects of aesthetics, we first introduce the concept of Aesthetic Relevance Score (ARS) of a sentence and have developed a model to automatically label a sentence with its ARS. We then use the ARS to design the ARIC model which includes an ARS weighted IAC loss function and an ARS based diverse aesthetic caption selector (DACS). We present extensive experimental results to show the soundness of the ARS concept and the effectiveness of the ARIC model by demonstrating that texts with higher ARS's can predict the aesthetic ratings more accurately and that the new ARIC model can generate more accurate, aesthetically more relevant and more diverse image captions. Furthermore, a large new research database containing 510K images with over 5 million comments and 350K aesthetic scores, and code for implementing ARIC are available at https://github.com/PengZai/ARIC.


title: Semi-Supervised Specific Emitter Identification Method Using Metric-Adversarial Training

abstract: Specific emitter identification (SEI) plays an increasingly crucial and potential role in both military and civilian scenarios. It refers to a process to discriminate individual emitters from each other by analyzing extracted characteristics from given radio signals. Deep learning (DL) and deep neural networks (DNNs) can learn the hidden features of data and build the classifier automatically for decision making, which have been widely used in the SEI research. Considering the insufficiently labeled training samples and large unlabeled training samples, semi-supervised learning-based SEI (SS-SEI) methods have been proposed. However, there are few SS-SEI methods focusing on extracting the discriminative and generalized semantic features of radio signals. In this paper, we propose an SS-SEI method using metric-adversarial training (MAT). Specifically, pseudo labels are innovatively introduced into metric learning to enable semi-supervised metric learning (SSML), and an objective function alternatively regularized by SSML and virtual adversarial training (VAT) is designed to extract discriminative and generalized semantic features of radio signals. The proposed MAT-based SS-SEI method is evaluated on an open-source large-scale real-world automatic-dependent surveillance-broadcast (ADS-B) dataset and WiFi dataset and is compared with state-of-the-art methods. The simulation results show that the proposed method achieves better identification performance than existing state-of-the-art methods. Specifically, when the ratio of the number of labeled training samples to the number of all training samples is 10\%, the identification accuracy is 84.80\% under the ADS-B dataset and 80.70\% under the WiFi dataset. Our code can be downloaded from https://github.com/lovelymimola/MAT-based-SS-SEI.


title: CaloMan: Fast generation of calorimeter showers with density estimation on learned manifolds

abstract: Precision measurements and new physics searches at the Large Hadron Collider require efficient simulations of particle propagation and interactions within the detectors. The most computationally expensive simulations involve calorimeter showers. Advances in deep generative modelling - particularly in the realm of high-dimensional data - have opened the possibility of generating realistic calorimeter showers orders of magnitude more quickly than physics-based simulation. However, the high-dimensional representation of showers belies the relative simplicity and structure of the underlying physical laws. This phenomenon is yet another example of the manifold hypothesis from machine learning, which states that high-dimensional data is supported on low-dimensional manifolds. We thus propose modelling calorimeter showers first by learning their manifold structure, and then estimating the density of data across this manifold. Learning manifold structure reduces the dimensionality of the data, which enables fast training and generation when compared with competing methods.

categories: hep-ph cs.LG hep-ex physics.data-an physics.ins-det


title: Incentive-Aware Recommender Systems in Two-Sided Markets

abstract: Online platforms in the Internet Economy commonly incorporate recommender systems that recommend products (or "arms") to users (or "agents"). A key challenge in this domain arises from myopic agents who are naturally incentivized to exploit by choosing the optimal arm based on current information, rather than exploring various alternatives to gather information that benefits the collective. We propose a novel recommender system that aligns with agents' incentives while achieving asymptotically optimal performance, as measured by regret in repeated interactions. Our framework models this incentive-aware system as a multi-agent bandit problem in two-sided markets, where the interactions of agents and arms are facilitated by recommender systems on online platforms. This model incorporates incentive constraints induced by agents' opportunity costs. In scenarios where opportunity costs are known to the platform, we show the existence of an incentive-compatible recommendation algorithm. This algorithm pools recommendations between a genuinely good arm and an unknown arm using a randomized and adaptive strategy. Moreover, when these opportunity costs are unknown, we introduce an algorithm that randomly pools recommendations across all arms, utilizing the cumulative loss from each arm as feedback for strategic exploration. We demonstrate that both algorithms satisfy an ex-post fairness criterion, which protects agents from over-exploitation. All code for using the proposed algorithms and reproducing results is made available on GitHub.


title: Neural Network Complexity of Chaos and Turbulence

abstract: Chaos and turbulence are complex physical phenomena, yet a precise definition of the complexity measure that quantifies them is still lacking. In this work we consider the relative complexity of chaos and turbulence from the perspective of deep neural networks. We analyze a set of classification problems, where the network has to distinguish images of fluid profiles in the turbulent regime from other classes of images such as fluid profiles in the chaotic regime, various constructions of noise and real world images. We analyze incompressible as well as weakly compressible fluid flows. We quantify the complexity of the computation performed by the network via the intrinsic dimensionality of the internal feature representations, and calculate the effective number of independent features which the network uses in order to distinguish between classes. In addition to providing a numerical estimate of the complexity of the computation, the measure also characterizes the neural network processing at intermediate and final stages. We construct adversarial examples and use them to identify the two point correlation spectra for the chaotic and turbulent vorticity as the feature used by the network for classification.


title: Deflated Multigrid Multilevel Monte Carlo

abstract: In lattice QCD, the trace of the inverse of the discretized Dirac operator appears in the disconnected fermion loop contribution to an observable. As simulation methods get more and more precise, these contributions become increasingly important. Hence, we consider here the problem of computing the trace $\mathrm{tr}(D^{-1})$, with $D$ the Dirac operator. The Hutchinson method, which is very frequently used to stochastically estimate the trace of a function of a matrix, approximates the trace as the average over estimates of the form $x^{H} D^{-1} x$, with the entries of the vector $x$ following a certain probability distribution. For $N$ samples, the accuracy is $\mathcal{O}(1/\sqrt{N})$. In recent work, we have introduced multigrid multilevel Monte Carlo: having a multigrid hierarchy with operators $D_{\ell}$, $P_{\ell}$ and $R_{\ell}$, for level $\ell$, we can rewrite the trace $\mathrm{tr}(D^{-1})$ via a telescopic sum with difference-levels, written in terms of the aforementioned operators and with a reduced variance. We have seen significant reductions in the variance and the total work with respect to exactly deflated Hutchinson. In this work, we explore the use of exact deflation in combination with the multigrid multilevel Monte Carlo method, and demonstrate how this leads to both algorithmic and computational gains.


title: Double Deep Q-Learning in Opponent Modeling

abstract: Multi-agent systems in which secondary agents with conflicting agendas also alter their methods need opponent modeling. In this study, we simulate the main agent's and secondary agents' tactics using Double Deep Q-Networks (DDQN) with a prioritized experience replay mechanism. Then, under the opponent modeling setup, a Mixture-of-Experts architecture is used to identify various opponent strategy patterns. Finally, we analyze our models in two environments with several agents. The findings indicate that the Mixture-of-Experts model, which is based on opponent modeling, performs better than DDQN.


title: Viscosity measurements of gaseous H2 between 200 K to 300 K with a spinning rotor gauge

abstract: Experimental values for the viscosity of the radioactive hydrogen isotopologue tritium are still unknown in literature. Existing values from ab initio calculations disregard quantum mechanic effects and are therefore only good approximations for room temperature and above. To fill in these missing experimental values, a measurement setup has been designed, to measure the viscosity of gaseous hydrogen and its isotopologues (H$_2$, HD, HT, D$_2$, DT, T$_2$) at cryogenic temperatures. In this paper, the first results with this Cryogenic Viscosity Measurement Apparatus (Cryo-ViMA) of the viscosity of gaseous hydrogen between 200 K to 300 K are presented.


title: PC-SNN: Supervised Learning with Local Hebbian Synaptic Plasticity based on Predictive Coding in Spiking Neural Networks

abstract: Deemed as the third generation of neural networks, the event-driven Spiking Neural Networks(SNNs) combined with bio-plausible local learning rules make it promising to build low-power, neuromorphic hardware for SNNs. However, because of the non-linearity and discrete property of spiking neural networks, the training of SNN remains difficult and is still under discussion. Originating from gradient descent, backprop has achieved stunning success in multi-layer SNNs. Nevertheless, it is assumed to lack biological plausibility, while consuming relatively high computational resources. In this paper, we propose a novel learning algorithm inspired by predictive coding theory and show that it can perform supervised learning fully autonomously and successfully as the backprop, utilizing only local Hebbian plasticity. Furthermore, this method achieves a favorable performance compared to the state-of-the-art multi-layer SNNs: test accuracy of 99.25% for the Caltech Face/Motorbike dataset, 84.25% for the ETH-80 dataset, 98.1% for the MNIST dataset and 98.5% for the neuromorphic dataset: N-MNIST. Furthermore, our work provides a new perspective on how supervised learning algorithms are directly implemented in spiking neural circuitry, which may give some new insights into neuromorphological calculation in neuroscience.


title: AIREPAIR: A Repair Platform for Neural Networks

abstract: We present AIREPAIR, a platform for repairing neural networks. It features the integration of existing network repair tools. Based on AIREPAIR, one can run different repair methods on the same model, thus enabling the fair comparison of different repair techniques. We evaluate AIREPAIR with three state-of-the-art repair tools on popular deep-learning datasets and models. Our evaluation confirms the utility of AIREPAIR, by comparing and analyzing the results from different repair techniques. A demonstration is available at https://youtu.be/UkKw5neeWhw.


title: Shifted Diffusion for Text-to-image Generation

abstract: We present Corgi, a novel method for text-to-image generation. Corgi is based on our proposed shifted diffusion model, which achieves better image embedding generation from input text. Unlike the baseline diffusion model used in DALL-E 2, our method seamlessly encodes prior knowledge of the pre-trained CLIP model in its diffusion process by designing a new initialization distribution and a new transition step of the diffusion. Compared to the strong DALL-E 2 baseline, our method performs better in generating image embedding from the text in terms of both efficiency and effectiveness, resulting in better text-to-image generation. Extensive large-scale experiments are conducted and evaluated in terms of both quantitative measures and human evaluation, indicating a stronger generation ability of our method compared to existing ones. Furthermore, our model enables semi-supervised and language-free training for text-to-image generation, where only part or none of the images in the training dataset have an associated caption. Trained with only 1.7% of the images being captioned, our semi-supervised model obtains FID results comparable to DALL-E 2 on zero-shot text-to-image generation evaluated on MS-COCO. Corgi also achieves new state-of-the-art results across different datasets on downstream language-free text-to-image generation tasks, outperforming the previous method, Lafite, by a large margin.


title: Elastic Valley Spin Controlled Chiral Coupling in Topological Valley Phononic Crystals

abstract: Distinct from the phononic valley pseudo-spin, the real physical spin of elastic waves adds a novel tool-kit capable of envisaging the valley-spin physics of topological valley phononic crystals from a local viewpoint. Here, we report the observation of local elastic valley spin as well as the hidden elastic spin-valley locking mechanism overlooked before. We demonstrate that the selective one-way routing of valley phonon states along the topological interface can be reversed by imposing the elastic spin meta-source at different interface locations with opposite valley-spin correspondence. We unveil the physical mechanism of selective directionality as the elastic spin controlled chiral coupling of valley phonon states, through both analytical theory and experimental measurement of the opposite local elastic spin density at different interface locations for different transport directions. The elastic spin of valley topological edge phonons can be extended to other topological states and offers new tool to explore topological metamaterials.


title: Deep Machine Learning for the PANDA Software Trigger

abstract: Deep machine learning methods have been studied for the software trigger of the future PANDA experiment at FAIR, using Monte Carlo simulated data from the GEANT-based detector simulation framework PandaRoot. Ten physics channels that cover the main physics topics, including electromagnetic, exotic, charmonium, open charm, and baryonic reaction channels, have been investigated at four different anti-proton beam momenta. Binary and multi-class classification together with seven different network architectures have been studied. Finally a residual convolutional neural network with four residual blocks in a binary classification scheme has been chosen due to its extendability, performance and stability. The presented study represents a feasibility study of a completely software-based trigger system. Compared to a conventional selection method, the deep machine learning approach achieved a significant efficiency gain of up to 200\%, while keeping the background reduction factor at the required level of 1/1000. Furthermore, it is shown that the use of additional input variables can improve the data quality for subsequent analysis. This study shows that the PANDA software trigger can benefit greatly from the deep machine learning methods.


title: Flat bands in Network Superstructures of Atomic Chains

abstract: We investigate the origin of the ubiquitous existence of flat bands in the network superstructures of atomic chains, where one-dimensional(1D) atomic chains array periodically. While there can be many ways to connect those chains, we consider two representative ways of linking them, the dot-type and triangle-type links. Then, we construct a variety of superstructures, such as the square, rectangular, and honeycomb network superstructures with dot-type links and the honeycomb superstructure with triangle-type links. These links provide the wavefunctions with an opportunity to have destructive interference, which stabilizes the compact localized state(CLS). The CLS is a localized eigenstate whose amplitudes are finite only inside a finite region and guarantees the existence of a flat band. In the network superstructures, there exist multiple flat bands proportional to the number of atoms of each chain, and the corresponding eigenenergies can be found from the stability condition of the compact localized state. Finally, we demonstrate that the finite bandwidth of the nearly flat bands of the network superstructures arising from the next-nearest-neighbor hopping processes can be suppressed by increasing the length of the chains consisting of the superstructures.


title: The Delannoy category

abstract: Let $G$ be the group of all order-preserving self-maps of the real line. In previous work, the first two authors constructed a pre-Tannakian category $\underline{\mathrm{Rep}}(G)$ associated to $G$. The present paper is a detailed study of this category, which we name the Delannoy category. We classify the simple objects, determine branching rules to open subgroups, and give a combinatorial rule for tensor products. The Delannoy category has some remarkable features: it is semi-simple in all characteristics; all simples have categorical dimension $\pm 1$; and the Adams operations on its Grothendieck group are trivial. We also give a combinatorial model for $\underline{\mathrm{Rep}}(G)$ based on Delannoy paths.


title: Video Test-Time Adaptation for Action Recognition

abstract: Although action recognition systems can achieve top performance when evaluated on in-distribution test points, they are vulnerable to unanticipated distribution shifts in test data. However, test-time adaptation of video action recognition models against common distribution shifts has so far not been demonstrated. We propose to address this problem with an approach tailored to spatio-temporal models that is capable of adaptation on a single video sample at a step. It consists in a feature distribution alignment technique that aligns online estimates of test set statistics towards the training statistics. We further enforce prediction consistency over temporally augmented views of the same test video sample. Evaluations on three benchmark action recognition datasets show that our proposed technique is architecture-agnostic and able to significantly boost the performance on both, the state of the art convolutional architecture TANet and the Video Swin Transformer. Our proposed method demonstrates a substantial performance gain over existing test-time adaptation approaches in both evaluations of a single distribution shift and the challenging case of random distribution shifts. Code will be available at \url{https://github.com/wlin-at/ViTTA}.


title: Closures of T-homogeneous braids are real algebraic

abstract: A link in $S^3$ is called real algebraic if it is the link of an isolated singularity of a polynomial map from $\mathbb{R}^4$ to $\mathbb{R}^2$. It is known that every real algebraic link is fibered and it is conjectured that the converse is also true. We prove this conjecture for a large family of fibered links, which includes closures of T-homogeneous (and therefore also homogeneous) braids and braids that can be written as a product of the dual Garside element and a positive word in the Birman-Ko-Lee presentation. The proof offers a construction of the corresponding real polynomial maps, which can be written as semiholomorphic functions. We obtain information about their polynomial degrees.


title: CodeExp: Explanatory Code Document Generation

abstract: Developing models that can automatically generate detailed code explanation can greatly benefit software maintenance and programming education. However, existing code-to-text generation models often produce only high-level summaries of code that do not capture implementation-level choices essential for these scenarios. To fill in this gap, we propose the code explanation generation task. We first conducted a human study to identify the criteria for high-quality explanatory docstring for code. Based on that, we collected and refined a large-scale code docstring corpus and formulated automatic evaluation metrics that best match human assessments. Finally, we present a multi-stage fine-tuning strategy and baseline models for the task. Our experiments show that (1) our refined training dataset lets models achieve better performance in the explanation generation tasks compared to larger unrefined data (15x larger), and (2) fine-tuned models can generate well-structured long docstrings comparable to human-written ones. We envision our training dataset, human-evaluation protocol, recommended metrics, and fine-tuning strategy can boost future code explanation research. The code and annotated data are available at https://github.com/subercui/CodeExp.


title: Stellar space weather effects on potentially habitable planets

abstract: Stellar activity can reveal itself in the form of radiation (eg, enhanced X-ray coronal emission, flares) and particles (eg, winds, coronal mass ejections). Together, these phenomena shape the space weather around (exo)planets. As stars evolve, so do their different forms of activity -- in general, younger solar-like stars have stronger winds, enhanced flare occurrence and likely more frequent coronal mass ejections. Altogether, these effects can create harsher particle and radiation environments for habitable-zone planets, in comparison to Earth, in particular at young ages. In this article, I will review some effects of these harsher environments on potentially habitable exoplanets.


title: Automating Systematic Literature Reviews with Natural Language Processing and Text Mining: a Systematic Literature Review

abstract: Objectives: An SLR is presented focusing on text mining based automation of SLR creation. The present review identifies the objectives of the automation studies and the aspects of those steps that were automated. In so doing, the various ML techniques used, challenges, limitations and scope of further research are explained. Methods: Accessible published literature studies that primarily focus on automation of study selection, study quality assessment, data extraction and data synthesis portions of SLR. Twenty-nine studies were analyzed. Results: This review identifies the objectives of the automation studies, steps within the study selection, study quality assessment, data extraction and data synthesis portions that were automated, the various ML techniques used, challenges, limitations and scope of further research. Discussion: We describe uses of NLP/TM techniques to support increased automation of systematic literature reviews. This area has attracted increase attention in the last decade due to significant gaps in the applicability of TM to automate steps in the SLR process. There are significant gaps in the application of TM and related automation techniques in the areas of data extraction, monitoring, quality assessment and data synthesis. There is thus a need for continued progress in this area, and this is expected to ultimately significantly facilitate the construction of systematic literature reviews.


title: Leveraging per Image-Token Consistency for Vision-Language Pre-training

abstract: Most existing vision-language pre-training (VLP) approaches adopt cross-modal masked language modeling (CMLM) to learn vision-language associations. However, we find that CMLM is insufficient for this purpose according to our observations: (1) Modality bias: a considerable amount of masked tokens in CMLM can be recovered with only the language information, ignoring the visual inputs. (2) Under-utilization of the unmasked tokens: CMLM primarily focuses on the masked token but it cannot simultaneously leverage other tokens to learn vision-language associations. To handle those limitations, we propose EPIC (lEveraging Per Image-Token Consistency for vision-language pre-training). In EPIC, for each image-sentence pair, we mask tokens that are salient to the image (i.e., Saliency-based Masking Strategy) and replace them with alternatives sampled from a language model (i.e., Inconsistent Token Generation Procedure), and then the model is required to determine for each token in the sentence whether it is consistent with the image (i.e., Image-Token Consistency Task). The proposed EPIC method is easily combined with pre-training methods. Extensive experiments show that the combination of the EPIC method and state-of-the-art pre-training approaches, including ViLT, ALBEF, METER, and X-VLM, leads to significant improvements on downstream tasks. The code is released at https://github.com/gyhdog99/epic.


title: The role of symmetric vibrational modes in the dehoherence of correlation-driven charge migration

abstract: Due to the electron correlation, a fast removal of an electron from a molecule may create a coherent superposition of cationic states and in this way initiate pure electronic dynamics in which the hole-charge left by ionization migrates throughout the system on an ultrashort time scale. The coupling to the nuclear motion introduces a decoherence that eventually traps the charge and a crucial question in the field of attochemistry is how long the electronic coherence lasts and which nuclear degrees of freedom are mostly responsible for the decoherence. Here, we report full-dimensional quantum calculations of the concerted electron-nuclear dynamics following outer-valence ionization of propynamide, which reveal that the pure electronic coherences last only 2-3 fs before being destroyed by the nuclear motion. Our analysis shows that the normal modes that are mostly responsible for the fast electronic decoherence are the symmetric in-plane modes. All other modes have little or no effect on the charge migration. This information can be useful to guide the development of reduced dimensionality models for larger systems or the search of molecules with long coherence times.


title: How has the solar wind evolved to become what it is today?

abstract: In this contribution, I briefly review the long-term evolution of the solar wind (its mass-loss rate), including the evolution of observed properties that are intimately linked to the solar wind (rotation, magnetism and activity). I also briefly discuss implications of the evolution of the solar wind on the evolving Earth. I argue that studying exoplanetary systems could open up new avenues for progress to be made in our understanding of the evolution of the solar wind.


title: MP-PCA denoising of fMRI time-series data can lead to artificial activation "spreading"

abstract: MP-PCA denoising has become the method of choice for denoising in MRI since it provides an objective threshold to separate the desired signal from unwanted thermal noise components. In rodents, thermal noise in the coils is an important source of noise that can reduce the accuracy of activation mapping in fMRI. Further confounding this problem, vendor data often contains zero-filling and other effects that may violate MP-PCA assumptions. Here, we develop an approach to denoise vendor data and assess activation "spreading" caused by MP-PCA denoising in rodent task-based fMRI data. Data was obtained from N = 3 mice using conventional multislice and ultrafast acquisitions (1 s and 50 ms temporal resolution, respectively), during visual stimulation. MP-PCA denoising produced SNR gains of 64% and 39% and Fourier spectral amplitude (FSA) increases in BOLD maps of 9% and 7% for multislice and ultrafast data, respectively, when using a small [2 2] denoising window. Larger windows provided higher SNR and FSA gains with increased spatial extent of activation that may or may not represent real activation. Simulations showed that MP-PCA denoising causes activation "spreading" with an increase in false positive rate and smoother functional maps due to local "bleeding" of principal components, and that the optimal denoising window for improved specificity of functional mapping, based on Dice score calculations, depends on the data's tSNR and functional CNR. This "spreading" effect applies also to another recently proposed low-rank denoising method (NORDIC). Our results bode well for dramatically enhancing spatial and/or temporal resolution in future fMRI work, while taking into account the sensitivity/specificity trade-offs of low-rank denoising methods.


title: Perceive, Ground, Reason, and Act: A Benchmark for General-purpose Visual Representation

abstract: Current computer vision models, unlike the human visual system, cannot yet achieve general-purpose visual understanding. Existing efforts to create a general vision model are limited in the scope of assessed tasks and offer no overarching framework to perform them holistically. We present a new comprehensive benchmark, General-purpose Visual Understanding Evaluation (G-VUE), covering the full spectrum of visual cognitive abilities with four functional domains $\unicode{x2014}$ Perceive, Ground, Reason, and Act. The four domains are embodied in 11 carefully curated tasks, from 3D reconstruction to visual reasoning and manipulation. Along with the benchmark, we provide a general encoder-decoder framework to allow for the evaluation of arbitrary visual representation on all 11 tasks. We evaluate various pre-trained visual representations with our framework and observe that (1) Transformer-based visual backbone generally outperforms CNN-based backbone on G-VUE, (2) visual representations from vision-language pre-training are superior to those with vision-only pre-training across visual tasks. With G-VUE, we provide a holistic evaluation standard to motivate research toward building general-purpose visual systems via obtaining more general-purpose visual representations.


title: Scale free distribution of oxygen interstitials wires in optimum doped HgBa$_2$CuO$_{4+y}$

abstract: Novel nanoscale probes are opening new venues for understanding unconventional electronic and magnetic functionalities driven by multiscale lattice complexity in doped high temperature superconducting perovskites. In this work we focus on the multiscale texture at supramolecular level of atomic oxygen interstitials (O-i) stripes in HgBa$_2$CuO$_{4+y}$ at optimal doping for the highest superconducting critical temperature $T_C$=94K. We report compelling evidence for the nematic phase of oxygen-interstitial O-i atomic wires with fractal-like spatial distribution over multiple scales by using scanning micro and nano X-ray-diffraction. The scale free distribution of O-i atomic wires at optimum doping extending from micron scale down to nanoscale has been associated with the intricate filamentary network of hole rich metallic wires in the CuO$_2$ plane. The observed critical opalescence provides evidence for the proximity to a critical point controlling the emergence of high temperature superconductivity at optimum doping


title: Modern DDoS Attacks and Defences -- Survey

abstract: Denial of Service (DoS) and Distributed Denial of Service of Service (DDoS) attacks are commonly used to disrupt network services. Attack techniques are always improving and due to the structure of the internet and properties of network protocols it is difficult to keep detection and mitigation techniques up to date. A lot of research has been conducted in this area which has demonstrated the difficulty of preventing DDoS attacks altogether, therefore the primary aim of most research is to maximize quality of service (QoS) for legitimate users. This survey paper aims to provide a clear summary of DDoS attacks and focuses on some recently proposed techniques for defence. The research papers that are analysed in depth primarily focused on the use of virtual machines (VMs) (HoneyMesh) and network function virtualization (NFV) (VGuard and VFence).


title: Malware and Exploits on the Dark Web

abstract: In recent years, the darknet has become the key location for the distribution of malware and exploits. We have seen scenarios where software vulnerabilities have been disclosed by vendors and shortly after, operational exploits are available on darknet forums and marketplaces. Many marketplace vendors offer zero-day exploits that have not yet been discovered or disclosed. This trend has led to security companies offering darknet analysis services to detect new exploits and malware, providing proactive threat intelligence. This paper presents information on the scale of malware distribution, the trends of malware types offered, the methods for discovering new exploits and the effectiveness of darknet analysis in detecting malware at the earliest possible stage.


title: Automated Detection of Dolphin Whistles with Convolutional Networks and Transfer Learning

abstract: Effective conservation of maritime environments and wildlife management of endangered species require the implementation of efficient, accurate and scalable solutions for environmental monitoring. Ecoacoustics offers the advantages of non-invasive, long-duration sampling of environmental sounds and has the potential to become the reference tool for biodiversity surveying. However, the analysis and interpretation of acoustic data is a time-consuming process that often requires a great amount of human supervision. This issue might be tackled by exploiting modern techniques for automatic audio signal analysis, which have recently achieved impressive performance thanks to the advances in deep learning research. In this paper we show that convolutional neural networks can indeed significantly outperform traditional automatic methods in a challenging detection task: identification of dolphin whistles from underwater audio recordings. The proposed system can detect signals even in the presence of ambient noise, at the same time consistently reducing the likelihood of producing false positives and false negatives. Our results further support the adoption of artificial intelligence technology to improve the automatic monitoring of marine ecosystems.


title: Fine-tuned Sentiment Analysis of COVID-19 Vaccine-Related Social Media Data: Comparative Study

abstract: This study investigated and compared public sentiment related to COVID-19 vaccines expressed on two popular social media platforms, Reddit and Twitter, harvested from January 1, 2020, to March 1, 2022. To accomplish this task, we created a fine-tuned DistilRoBERTa model to predict sentiments of approximately 9.5 million Tweets and 70 thousand Reddit comments. To fine-tune our model, our team manually labeled the sentiment of 3600 Tweets and then augmented our dataset by the method of back-translation. Text sentiment for each social media platform was then classified with our fine-tuned model using Python and the Huggingface sentiment analysis pipeline. Our results determined that the average sentiment expressed on Twitter was more negative (52% positive) than positive and the sentiment expressed on Reddit was more positive than negative (53% positive). Though average sentiment was found to vary between these social media platforms, both displayed similar behavior related to sentiment shared at key vaccine-related developments during the pandemic. Considering this similar trend in shared sentiment demonstrated across social media platforms, Twitter and Reddit continue to be valuable data sources that public health officials can utilize to strengthen vaccine confidence and combat misinformation. As the spread of misinformation poses a range of psychological and psychosocial risks (anxiety, fear, etc.), there is an urgency in understanding the public perspective and attitude toward shared falsities. Comprehensive educational delivery systems tailored to the population's expressed sentiments that facilitate digital literacy, health information-seeking behavior, and precision health promotion could aid in clarifying such misinformation.


title: Fuzziness, Indeterminacy and Soft Sets: Frontiers and Perspectives

abstract: The present paper comes across the main steps that laid from Zadeh's fuzziness ana Atanassov's intuitionistic fuzzy sets to Smarandache's indeterminacy and to Molodstov's soft sets. Two hybrid methods for assessment and decision making respectively under fuzzy conditions are also presented through suitable examples that use soft sets and real intervals as tools. The decision making method improves an earlier method of Maji et al. Further, it is described how the concept of topological space, the most general category of mathematical spaces, can be extended to fuzzy structures and how to generalize the fundamental mathematical concepts of limit, continuity compactness and Hausdorff space within such kind of structures. In particular, fuzzy and soft topological spaces are defined and examples are given to illustrate these generalizations.


title: A framework for structural shape optimization based on automatic differentiation, the adjoint method and accelerated linear algebra

abstract: Shape optimization is of great significance in structural engineering, as an efficient geometry leads to better performance of structures. However, the application of gradient-based shape optimization for structural and architectural design is limited, which is partly due to the difficulty and the complexity in gradient evaluation. In this work, an efficient framework based on automatic differentiation (AD), the adjoint method and accelerated linear algebra (XLA) is proposed to promote the implementation of gradient-based shape optimization. The framework is realized by the implementation of the high-performance computing (HPC) library JAX. We leverage AD for gradient evaluation in the sensitivity analysis stage. Compared to numerical differentiation, AD is more accurate; compared to analytical and symbolic differentiation, AD is more efficient and easier to apply. In addition, the adjoint method is used to reduce the complexity of computation of the sensitivity. The XLA feature is exploited by an efficient programming architecture that we proposed, which can boost gradient evaluation. The proposed framework also supports hardware acceleration such as GPUs. The framework is applied to the form finding of arches and different free-form gridshells: gridshell inspired by Mannheim Multihalle, four-point supported gridshell, and canopy-like structures. Two geometric descriptive methods are used: non-parametric and parametric description via B\'ezier surface. Non-constrained and constrained shape optimization problems are considered, where the former is solved by gradient descent and the latter is solved by sequential quadratic programming (SQP). Through these examples, the proposed framework is shown to be able to provide structural engineers with a more efficient tool for shape optimization, enabling better design for the built environment.


title: Private Multi-Winner Voting for Machine Learning

abstract: Private multi-winner voting is the task of revealing $k$-hot binary vectors satisfying a bounded differential privacy (DP) guarantee. This task has been understudied in machine learning literature despite its prevalence in many domains such as healthcare. We propose three new DP multi-winner mechanisms: Binary, $\tau$, and Powerset voting. Binary voting operates independently per label through composition. $\tau$ voting bounds votes optimally in their $\ell_2$ norm for tight data-independent guarantees. Powerset voting operates over the entire binary vector by viewing the possible outcomes as a power set. Our theoretical and empirical analysis shows that Binary voting can be a competitive mechanism on many tasks unless there are strong correlations between labels, in which case Powerset voting outperforms it. We use our mechanisms to enable privacy-preserving multi-label learning in the central setting by extending the canonical single-label technique: PATE. We find that our techniques outperform current state-of-the-art approaches on large, real-world healthcare data and standard multi-label benchmarks. We further enable multi-label confidential and private collaborative (CaPC) learning and show that model performance can be significantly improved in the multi-site setting.


title: Solving Collaborative Dec-POMDPs with Deep Reinforcement Learning Heuristics

abstract: WQMIX, QMIX, QTRAN, and VDN are SOTA algorithms for Dec-POMDP. All of them cannot solve complex agents' cooperation domains. We give an algorithm to solve such problems. In the first stage, we solve a single-agent problem and get a policy. In the second stage, we solve the multi-agent problem with the single-agent policy. SA2MA has a clear advantage over all competitors in complex agents' cooperative domains.


title: STE-QUEST: Space Time Explorer and QUantum Equivalence principle Space Test

abstract: An M-class mission proposal in response to the 2021 call in ESA's science programme with a broad range of objectives in fundamental physics, which include testing the Equivalence Principle and Lorentz Invariance, searching for Ultralight Dark Matter and probing Quantum Mechanics.

categories: physics.space-ph gr-qc hep-ex hep-ph quant-ph


title: Towards Developing Safety Assurance Cases for Learning-Enabled Medical Cyber-Physical Systems

abstract: Machine Learning (ML) technologies have been increasingly adopted in Medical Cyber-Physical Systems (MCPS) to enable smart healthcare. Assuring the safety and effectiveness of learning-enabled MCPS is challenging, as such systems must account for diverse patient profiles and physiological dynamics and handle operational uncertainties. In this paper, we develop a safety assurance case for ML controllers in learning-enabled MCPS, with an emphasis on establishing confidence in the ML-based predictions. We present the safety assurance case in detail for Artificial Pancreas Systems (APS) as a representative application of learning-enabled MCPS, and provide a detailed analysis by implementing a deep neural network for the prediction in APS. We check the sufficiency of the ML data and analyze the correctness of the ML-based prediction using formal verification. Finally, we outline open research problems based on our experience in this paper.


title: Dynamic Collaborative Multi-Agent Reinforcement Learning Communication for Autonomous Drone Reforestation

abstract: We approach autonomous drone-based reforestation with a collaborative multi-agent reinforcement learning (MARL) setup. Agents can communicate as part of a dynamically changing network. We explore collaboration and communication on the back of a high-impact problem. Forests are the main resource to control rising CO2 conditions. Unfortunately, the global forest volume is decreasing at an unprecedented rate. Many areas are too large and hard to traverse to plant new trees. To efficiently cover as much area as possible, here we propose a Graph Neural Network (GNN) based communication mechanism that enables collaboration. Agents can share location information on areas needing reforestation, which increases viewed area and planted tree count. We compare our proposed communication mechanism with a multi-agent baseline without the ability to communicate. Results show how communication enables collaboration and increases collective performance, planting precision and the risk-taking propensity of individual agents.


title: Machine Learning for Screening Large Organic Molecules

abstract: Organic semiconductors are promising materials for cheap, scalable and sustainable electronics, light-emitting diodes and photovoltaics. For organic photovoltaic cells, it is a challenge to find compounds with suitable properties in the vast chemical compound space. For example, the ionization energy should fit to the optical spectrum of sun light, and the energy levels must allow efficient charge transport. Here, a machine-learning model is developed for rapidly and accurately estimating the HOMO and LUMO energies of a given molecular structure. It is build upon the SchNet model (Sch\"utt et al. (2018)) and augmented with a `Set2Set' readout module (Vinyals et al. (2016)). The Set2Set module has more expressive power than sum and average aggregation and is more suitable for the complex quantities under consideration. Most previous models have been trained and evaluated on rather small molecules. Therefore, the second contribution is extending the scope of machine-learning methods by adding also larger molecules from other sources and establishing a consistent train/validation/test split. As a third contribution, we make a multitask ansatz to resolve the problem of different sources coming at different levels of theory. All three contributions in conjunction bring the accuracy of the model close to chemical accuracy.


title: Development of a Neural Network-Based Mathematical Operation Protocol for Embedded Hexadecimal Digits Using Neural Architecture Search (NAS)

abstract: It is beneficial to develop an efficient machine-learning based method for addition using embedded hexadecimal digits. Through a comparison between human-developed machine learning model and models sampled through Neural Architecture Search (NAS) we determine an efficient approach to solve this problem with a final testing loss of 0.2937 for a human-developed model.


title: Proof-of-randomness protocol for blockchain consensus: a case of Macau algorithms

abstract: A proof-of-randomness (PoR) protocol is a fair and low energy-cost consensus mechanism for blockchains. Each network node of a blockchain may use a true random number generator (TRNG) and hash algorism to fulfil the PoR protocol. In this whitepaper, we give the consensus mechanism of the PoR protocol, and classify it into a new kind of randomized algorithms called Macau. The PoR protocol could generate a blockchain without any competition of computing power or stake of cryptocurrency. Besides, we give some advantages of integrating quantum random number generator (QRNG) chips into hardware wallets, and also discuss the way to cooperate with quantum key distribution (QKD) technology.


title: Irradiation of luminescence dosimeters in pulsed mixed radiation fields

abstract: UHDpulse - Metrology for Advanced Radiotherapy using beams with Ultra-High Pulse Dose Rates is a European project aimed at developing novel dosimetry standards, as well as improving existing ones, for FLASH radiotherapy, very high energy electrons radiotherapy, and laser-driven medical accelerators. Within the scope of this project, Thermoluminescence (TL) and Optically Stimulated Luminescence (OSL) detectors are used to measure stray radiation fields. Experiments performed with conventional pulsed particle-beams allow to characterize the dosimeters in known and controllable radiation fields. In turn, this allows to develop models and predict their behavior in complex radiation fields, such as those at laser-driven and FLASH facilities. TL and OSL detectors were irradiated at the Microtron MT25 electron accelerator in Prague, Czech Republic. GAFChromicTM films and plastic nuclear track detectors were used to study the beam profile and the neutron background respectively. The responses of the different detector to the pulsed mixed radiation fields of the Microtron MT25 are compared among each other and presented in this paper.


title: SILCC VII -- Gas kinematics and multiphase outflows of the simulated ISM at high gas surface densities

abstract: We present magnetohydrodynamic (MHD) simulations of the star-forming multiphase interstellar medium (ISM) in stratified galactic patches with gas surface densities $\Sigma_\mathrm{gas} =$ 10, 30, 50, and 100 $\mathrm{M_\odot\,pc^{-2}}$. The SILCC project simulation framework accounts for non-equilibrium thermal and chemical processes in the warm and cold ISM. The sink-based star formation and feedback model includes stellar winds, hydrogen-ionising UV radiation, core-collapse supernovae, and cosmic ray (CR) injection and diffusion. The simulations follow the observed relation between $\Sigma_\mathrm{gas}$ and the star formation rate surface density $\Sigma_\mathrm{SFR}$. CRs qualitatively change the outflow phase structure. Without CRs, the outflows transition from a two-phase (warm and hot at 1 kpc) to a single-phase (hot at 2 kpc) structure. With CRs, the outflow always has three phases (cold, warm, and hot), dominated in mass by the warm phase. The impact of CRs on mass loading decreases for higher $\Sigma_\mathrm{gas}$ and the mass loading factors of the CR-supported outflows are of order unity independent of $\Sigma_\mathrm{SFR}$. Similar to observations, vertical velocity dispersions of the warm ionised medium (WIM) and the cold neutral medium (CNM) correlate with the star formation rate as $\sigma_\mathrm{z} \propto \Sigma_\mathrm{SFR}^a$, with $a \sim 0.20$. In the absence of stellar feedback, we find no correlation. The velocity dispersion of the WIM is a factor $\sim 2.2$ higher than that of the CNM, in agreement with local observations. For $\Sigma_\mathrm{SFR} \gtrsim 1.5 \times 10^{-2}\,\mathrm{M}_\odot\,\mathrm{yr}^{-1}\,\mathrm{kpc}^{-2}$ the WIM motions become supersonic.


title: Equivariant Networks for Crystal Structures

abstract: Supervised learning with deep models has tremendous potential for applications in materials science. Recently, graph neural networks have been used in this context, drawing direct inspiration from models for molecules. However, materials are typically much more structured than molecules, which is a feature that these models do not leverage. In this work, we introduce a class of models that are equivariant with respect to crystalline symmetry groups. We do this by defining a generalization of the message passing operations that can be used with more general permutation groups, or that can alternatively be seen as defining an expressive convolution operation on the crystal graph. Empirically, these models achieve competitive results with state-of-the-art on property prediction tasks.


title: VRDU: A Benchmark for Visually-rich Document Understanding

abstract: Understanding visually-rich business documents to extract structured data and automate business workflows has been receiving attention both in academia and industry. Although recent multi-modal language models have achieved impressive results, we find that existing benchmarks do not reflect the complexity of real documents seen in industry. In this work, we identify the desiderata for a more comprehensive benchmark and propose one we call Visually Rich Document Understanding (VRDU). VRDU contains two datasets that represent several challenges: rich schema including diverse data types as well as hierarchical entities, complex templates including tables and multi-column layouts, and diversity of different layouts (templates) within a single document type. We design few-shot and conventional experiment settings along with a carefully designed matching algorithm to evaluate extraction results. We report the performance of strong baselines and offer three observations: (1) generalizing to new document templates is still very challenging, (2) few-shot performance has a lot of headroom, and (3) models struggle with hierarchical fields such as line-items in an invoice. We plan to open source the benchmark and the evaluation toolkit. We hope this helps the community make progress on these challenging tasks in extracting structured data from visually rich documents.


title: Active thermal metasurfaces for remote heating/cooling by mimicking negative thermal conductivity

abstract: Remote temperature control can be obtained by a long-focus thermal lens that can focus heat fluxes into a spot far away from the back surface of the lens and create a virtual thermal source/sink in the background material, around which the temperature field distribution can be remotely controlled by changing the parameters of the thermal lens. However, due to the lack of negative thermal conductivity, the existing thermal lenses have extremely short focal lengths and cannot be used to remotely control the temperature field around the virtual thermal source/sink. In this study, we theoretically propose a general approach to equivalently realize negative thermal conductivity by elaborately distributed active thermal metasurface (ATMS), then use the proposed ATMS to implement a novel thermal lens with long focal length designed by transformation thermodynamics, and experimentally verify the performance of the designed long-focus thermal lens with measured focal length f=19.8mm for remote heating/cooling. The proposed method expands the scope of the thermal conductivity and open up new ways to realize unprecedented thermal effects with effective negative thermal conductivity, such as "thermal surface plasmon polaritons", thermal superlens, thermal tunneling effect, and thermal invisible gateway.


title: Effective Data Sampling Strategies and Boundary Condition Constraints of Physics-Informed Neural Networks for Identifying Material Properties in Solid Mechanics

abstract: Material identification is critical for understanding the relationship between mechanical properties and the associated mechanical functions. However, material identification is a challenging task, especially when the characteristic of the material is highly nonlinear in nature, as is common in biological tissue. In this work, we identify unknown material properties in continuum solid mechanics via physics-informed neural networks (PINNs). To improve the accuracy and efficiency of PINNs, we developed efficient strategies to nonuniformly sample observational data. We also investigated different approaches to enforce Dirichlet boundary conditions as soft or hard constraints. Finally, we apply the proposed methods to a diverse set of time-dependent and time-independent solid mechanic examples that span linear elastic and hyperelastic material space. The estimated material parameters achieve relative errors of less than 1%. As such, this work is relevant to diverse applications, including optimizing structural integrity and developing novel materials.


title: DeepParliament: A Legal domain Benchmark & Dataset for Parliament Bills Prediction

abstract: This paper introduces DeepParliament, a legal domain Benchmark Dataset that gathers bill documents and metadata and performs various bill status classification tasks. The proposed dataset text covers a broad range of bills from 1986 to the present and contains richer information on parliament bill content. Data collection, detailed statistics and analyses are provided in the paper. Moreover, we experimented with different types of models ranging from RNN to pretrained and reported the results. We are proposing two new benchmarks: Binary and Multi-Class Bill Status classification. Models developed for bill documents and relevant supportive tasks may assist Members of Parliament (MPs), presidents, and other legal practitioners. It will help review or prioritise bills, thus speeding up the billing process, improving the quality of decisions and reducing the time consumption in both houses. Considering that the foundation of the country's democracy is Parliament and state legislatures, we anticipate that our research will be an essential addition to the Legal NLP community. This work will be the first to present a Parliament bill prediction task. In order to improve the accessibility of legal AI resources and promote reproducibility, we have made our code and dataset publicly accessible at github.com/monk1337/DeepParliament


title: FAF: A novel multimodal emotion recognition approach integrating face, body and text

abstract: Multimodal emotion analysis performed better in emotion recognition depending on more comprehensive emotional clues and multimodal emotion dataset. In this paper, we developed a large multimodal emotion dataset, named "HED" dataset, to facilitate the emotion recognition task, and accordingly propose a multimodal emotion recognition method. To promote recognition accuracy, "Feature After Feature" framework was used to explore crucial emotional information from the aligned face, body and text samples. We employ various benchmarks to evaluate the "HED" dataset and compare the performance with our method. The results show that the five classification accuracy of the proposed multimodal fusion method is about 83.75%, and the performance is improved by 1.83%, 9.38%, and 21.62% respectively compared with that of individual modalities. The complementarity between each channel is effectively used to improve the performance of emotion recognition. We had also established a multimodal online emotion prediction platform, aiming to provide free emotion prediction to more users.


title: AI Knows Which Words Will Appear in Next Year's Korean CSAT

abstract: A text-mining-based word class categorization method and LSTM-based vocabulary pattern prediction method are introduced in this paper. A preprocessing method based on simple text appearance frequency analysis is first described. This method was developed as a data screening tool but showed 4.35 ~ 6.21 times higher than previous works. An LSTM deep learning method is also suggested for vocabulary appearance pattern prediction method. AI performs a regression with various size of data window of previous exams to predict the probabilities of word appearance in the next exam. Predicted values of AI over various data windows are processed into a single score as a weighted sum, which we call an "AI-Score", which represents the probability of word appearance in next year's exam. Suggested method showed 100% accuracy at the range 100-score area and showed only 1.7% error of prediction in the section where the scores were over 60 points. All source codes are freely available at the authors' Git Hub repository. (https://github.com/needleworm/bigdata_voca)


title: Quantum Simulation of the Radical Pair Dynamics of the Avian Compass

abstract: The simulation of open quantum dynamics on quantum circuits has attracted wide interests recently with a variety of quantum algorithms developed and demonstrated. Among these, one particular design of a unitary-dilation-based quantum algorithm is capable of simulating general and complex physical systems. In this paper, we apply this quantum algorithm to simulating the dynamics of the radical pair mechanism in the avian compass. This application is demonstrated on the IBM QASM quantum simulator. This work is the first application of any quantum algorithm to simulating the radical pair mechanism in the avian compass, which not only demonstrates the generality of the quantum algorithm, but also opens new opportunities for studying the avian compass with quantum computing devices.


title: Explanation on Pretraining Bias of Finetuned Vision Transformer

abstract: As the number of fine tuning of pretrained models increased, understanding the bias of pretrained model is essential. However, there is little tool to analyse transformer architecture and the interpretation of the attention maps is still challenging. To tackle the interpretability, we propose Input-Attribution and Attention Score Vector (IAV) which measures the similarity between attention map and input-attribution and shows the general trend of interpretable attention patterns. We empirically explain the pretraining bias of supervised and unsupervised pretrained ViT models, and show that each head in ViT has a specific range of agreement on the decision of the classification. We show that generalization, robustness and entropy of attention maps are not property of pretraining types. On the other hand, IAV trend can separate the pretraining types.


title: Detecting Methane Plumes using PRISMA: Deep Learning Model and Data Augmentation

abstract: The new generation of hyperspectral imagers, such as PRISMA, has improved significantly our detection capability of methane (CH4) plumes from space at high spatial resolution (30m). We present here a complete framework to identify CH4 plumes using images from the PRISMA satellite mission and a deep learning model able to detect plumes over large areas. To compensate for the relative scarcity of PRISMA images, we trained our model by transposing high resolution plumes from Sentinel-2 to PRISMA. Our methodology thus avoids computationally expensive synthetic plume generation from Large Eddy Simulations by generating a broad and realistic training database, and paves the way for large-scale detection of methane plumes using future hyperspectral sensors (EnMAP, EMIT, CarbonMapper).


title: Analysis of a two-layer energy balance model: long time behaviour and greenhouse effect

abstract: We study a two-layer energy balance model, that allows for vertical exchanges between a surface layer and the atmosphere. The evolution equations of the surface temperature and the atmospheric temperature are coupled by the emission of infrared radiation by one level, that emission being captured by the other layer, and the effect of all non radiative vertical exchanges of energy. Therefore, an essential parameter is the absorptivity of the atmosphere, denoted $\epsilon_a$. The value of $\epsilon_a$ depends critically on greenhouse gases: increasing concentrations of $CO_2$ and $CH_4$ lead to a more opaque atmosphere with higher values of $\epsilon_a$. First we prove that global existence of solutions of the system holds if and only if $\epsilon_a \in (0, 2)$, and blow up in finite time occurs if $\epsilon_a > 2$. (Note that the physical range of values for $\epsilon_a$ is $(0, 1]$.) Next, we explain the long time dynamics for $\epsilon_a \in (0, 2)$, and we prove that all solutions converge to some equilibrium point. Finally, motivated by the physical context, we study the dependence of the equilibrium points with respect to the involved parameters, and we prove in particular that the surface temperature increases with respect to $\epsilon_a$. This is the key mathematical manifestation of the greenhouse effect.


title: Endogenous Distress Contagion in a Dynamic Interbank Model

abstract: In this work we introduce an interbank network with stochastic dynamics subject to an endogenous notion of distress contagion that accounts for worries about future defaults within the network. Specifically, this entails a forward-backward approach to the equilibrium dynamics, enforced by a mark-to-market valuation adjustment for interbank claims, whereby the conditional probabilities of future defaults are required to determine today's balance sheets. Distinct from static models, the resulting distress contagion acts as a stochastic volatility term which leads, endogenously, to volatility clustering and a marked downside leverage effect. Moreover, by considering multiple maturities, our model provides a systemic risk-aware term structure for interbank claims. We present the analysis in two parts: (i) a single maturity setting that closely matches the traditional interbank network literature, and (ii) a multiple maturity setting to examine the impact of systemic risk on the full term structure. Numerical case studies are presented throughout to demonstrate the financial implications of this systemic risk model.


title: E2E Segmentation in a Two-Pass Cascaded Encoder ASR Model

abstract: We explore unifying a neural segmenter with two-pass cascaded encoder ASR into a single model. A key challenge is allowing the segmenter (which runs in real-time, synchronously with the decoder) to finalize the 2nd pass (which runs 900 ms behind real-time) without introducing user-perceived latency or deletion errors during inference. We propose a design where the neural segmenter is integrated with the causal 1st pass decoder to emit a end-of-segment (EOS) signal in real-time. The EOS signal is then used to finalize the non-causal 2nd pass. We experiment with different ways to finalize the 2nd pass, and find that a novel dummy frame injection strategy allows for simultaneous high quality 2nd pass results and low finalization latency. On a real-world long-form captioning task (YouTube), we achieve 2.4% relative WER and 140 ms EOS latency gains over a baseline VAD-based segmenter with the same cascaded encoder.


title: Hallmarks of non-trivial topology in Josephson junctions based on oxide nanochannels

abstract: We investigate the topological properties of a Josephson junction obtained by constraining a two-dimensional electron gas at oxide interface to form a quasi-1D conductor. We reveal an anomalous critical current behaviour with a magnetic field applied perpendicular to the Rashba spin-orbit one. We relate the observed critical current enhancement at small magnetic fields with a non-trivial topology, accompanied by Majorana bound states (MBSs) pinned at the edges of the superconducting leads. Signatures of MBSs also include a sawtooth profile in the current-phase relation. Our findings allow to recognize fingerprints of topological superconductivity in non-centrosymmetric materials and confined systems with Rashba spin-orbit interaction, and to explain recent experimental observations for which a microscopic description is still lacking.


title: ISPY-NACO Imaging Survey for Planets around Young stars. The demographics of forming planets embedded in protoplanetary disks

abstract: We present the statistical analysis of a subsample of 45 young stars surrounded by protoplanetary disks (PPDs). This is the largest imaging survey uniquely focused on PPDs to date. Our goal is to search for young forming companions embedded in the disk material and to constrain their occurrence rate in relation to the formation mechanism. We used principal component analysis based point spread function subtraction techniques to reveal young companions forming in the disks. We calculated detection limits for our datasets and adopted a black-body model to derive temperature upper limits of potential forming planets. We then used Monte Carlo simulations to constrain the population of forming gas giant companions and compare our results to different types of formation scenarios. Our data revealed a new binary system (HD38120) and a recently identified triple system with a brown dwarf companion orbiting a binary system (HD101412), in addition to 12 known companions. Furthermore, we detected signals from 17 disks, two of which (HD72106 and TCrA) were imaged for the first time. We reached median detection limits of L =15.4 mag at 2.0 arcsec, which were used to investigate the temperature of potentially embedded forming companions. We can constrain the occurrence of forming planets with semi-major axis a in [20 - 500] au and Teff in [600 - 3000] K, in line with the statistical results obtained for more evolved systems from other direct imaging surveys. The NaCo-ISPY data confirm that massive bright planets accreting at high rates are rare. More powerful instruments with better sensitivity in the near- to mid-infrared are likely required to unveil the wealth of forming planets sculpting the observed disk substructures.


title: Hyperspectral Demosaicing of Snapshot Camera Images Using Deep Learning

abstract: Spectral imaging technologies have rapidly evolved during the past decades. The recent development of single-camera-one-shot techniques for hyperspectral imaging allows multiple spectral bands to be captured simultaneously (3x3, 4x4 or 5x5 mosaic), opening up a wide range of applications. Examples include intraoperative imaging, agricultural field inspection and food quality assessment. To capture images across a wide spectrum range, i.e. to achieve high spectral resolution, the sensor design sacrifices spatial resolution. With increasing mosaic size, this effect becomes increasingly detrimental. Furthermore, demosaicing is challenging. Without incorporating edge, shape, and object information during interpolation, chromatic artifacts are likely to appear in the obtained images. Recent approaches use neural networks for demosaicing, enabling direct information extraction from image data. However, obtaining training data for these approaches poses a challenge as well. This work proposes a parallel neural network based demosaicing procedure trained on a new ground truth dataset captured in a controlled environment by a hyperspectral snapshot camera with a 4x4 mosaic pattern. The dataset is a combination of real captured scenes with images from publicly available data adapted to the 4x4 mosaic pattern. To obtain real world ground-truth data, we performed multiple camera captures with 1-pixel shifts in order to compose the entire data cube. Experiments show that the proposed network outperforms state-of-art networks.


title: Context-Adaptive Deep Neural Networks via Bridge-Mode Connectivity

abstract: The deployment of machine learning models in safety-critical applications comes with the expectation that such models will perform well over a range of contexts (e.g., a vision model for classifying street signs should work in rural, city, and highway settings under varying lighting/weather conditions). However, these one-size-fits-all models are typically optimized for average case performance, encouraging them to achieve high performance in nominal conditions but exposing them to unexpected behavior in challenging or rare contexts. To address this concern, we develop a new method for training context-dependent models. We extend Bridge-Mode Connectivity (BMC) (Garipov et al., 2018) to train an infinite ensemble of models over a continuous measure of context such that we can sample model parameters specifically tuned to the corresponding evaluation context. We explore the definition of context in image classification tasks through multiple lenses including changes in the risk profile, long-tail image statistics/appearance, and context-dependent distribution shift. We develop novel extensions of the BMC optimization for each of these cases and our experiments demonstrate that model performance can be successfully tuned to context in each scenario.


title: Analytic Estimation of Region of Attraction of an LQR Controller for Torque Limited Simple Pendulum

abstract: Linear-quadratic regulators (LQR) are a well known and widely used tool in control theory for both linear and nonlinear dynamics. For nonlinear problems, an LQR-based controller is usually only locally viable, thus, raising the problem of estimating the region of attraction (ROA). The need for good ROA estimations becomes especially pressing for underactuated systems, as a failure of controls might lead to unsafe and unrecoverable system states. Known approaches based on optimization or sampling, while working well, might be too slow in time critical applications and are hard to verify formally. In this work, we propose a novel approach to estimate the ROA based on the analytic solutions to linear ODEs for the torque limited simple pendulum. In simulation and physical experiments, we compared our approach to a Lyapunov-sampling baseline approach and found that our approach was faster to compute, while yielding ROA estimations of similar phase space area.


title: High-efficiency interface between multi-mode and single-mode fibers

abstract: Multi-mode fibers (MMFs) and single-mode fibers (SMFs) are widely used in optical communication networks. MMFs are the practical choice in terms of cost in applications that require short distances. Beyond that, SMFs are necessary because of the modal dispersion in MMFs. Here, we present a method capable of interfacing an MMF with an SMF using a re-programmable multi-plane light conversion scheme (MPLC). We demonstrate that only 3-phase modulations are necessary to achieve MMF-to-SMF coupling efficiencies from 30\% to 70\% for MMF's with core diameters up to 200 microns. We show how the obtained coupling efficiency can be recovered if the output field of the MMF changes entirely, e.g. through strong deformation of the fiber, by simple monitoring of the field. Furthermore, we test the influence of the resolution of both essential devices (field reconstruction and MPLC) on coupling efficiencies. We find that commercially available devices with increased speed and efficiency, such as wavefront sensors and deformable mirrors, are sufficient for establishing an MMF to SMF interface which auto-corrects any decoupling in the kHz regime.


title: Probabilistic Modelling of Signal Mixtures with Differentiable Dictionaries

abstract: We introduce a novel way to incorporate prior information into (semi-) supervised non-negative matrix factorization, which we call differentiable dictionary search. It enables general, highly flexible and principled modelling of mixtures where non-linear sources are linearly mixed. We study its behavior on an audio decomposition task, and conduct an extensive, highly controlled study of its modelling capabilities.


title: Near-Field Channel Estimation for Extremely Large-Scale Array Communications: A model-based deep learning approach

abstract: Extremely large-scale massive MIMO (XL-MIMO) has been reviewed as a promising technology for future wireless communications. The deployment of XL-MIMO, especially at high-frequency bands, leads to users being located in the near-field region instead of the conventional far-field. This letter proposes efficient model-based deep learning algorithms for estimating the near-field wireless channel of XL-MIMO communications. In particular, we first formulate the XL-MIMO near-field channel estimation task as a compressed sensing problem using the spatial gridding-based sparsifying dictionary, and then solve the resulting problem by applying the Learning Iterative Shrinkage and Thresholding Algorithm (LISTA). Due to the near-field characteristic, the spatial gridding-based sparsifying dictionary may result in low channel estimation accuracy and a heavy computational burden. To address this issue, we further propose a new sparsifying dictionary learning-LISTA (SDL-LISTA) algorithm that formulates the sparsifying dictionary as a neural network layer and embeds it into LISTA neural network. The numerical results show that our proposed algorithms outperform non-learning benchmark schemes, and SDL-LISTA achieves better performance than LISTA with ten times atoms reduction.


title: Graceful Forgetting II. Data as a Process

abstract: Data are rapidly growing in size and importance for society, a trend motivated by their enabling power. The accumulation of new data, sustained by progress in technology, leads to a boundless expansion of stored data, in some cases with an exponential increase in the accrual rate itself. Massive data are hard to process, transmit, store, and exploit, and it is particularly hard to keep abreast of the data store as a whole. This paper distinguishes three phases in the life of data: acquisition, curation, and exploitation. Each involves a distinct process, that may be separated from the others in time, with a different set of priorities. The function of the second phase, curation, is to maximize the future value of the data given limited storage. I argue that this requires that (a) the data take the form of summary statistics and (b) these statistics follow an endless process of rescaling. The summary may be more compact than the original data, but its data structure is more complex and it requires an on-going computational process that is much more sophisticated than mere storage. Rescaling results in dimensionality reduction that may be beneficial for learning, but that must be carefully controlled to preserve relevance. Rescaling may be tuned based on feedback from usage, with the proviso that our memory of the past serves the future, the needs of which are not fully known.


title: On the r\^ole of singular functions in extending the probabilistic symbol to its most general class

abstract: The probabilistic symbol is the right-hand side derivative of the characteristic functions corresponding to the one-dimensional marginals of a stochastic process. This object, as long as the derivative exists, provides crucial information concerning the stochastic process. For a L\'evy process, one obtains the characteristic exponent while the symbol of a (rich) Feller process coincides with the classical symbol which is well known from the theory of pseudodifferential operators. Leaving these classes behind, the most general class of processes for which the symbol still exists are L\'evy-type processes. It has been an open question, whether further generalizations are possible within the framework of Markov processes. We answer this question in the present article: within the class of Hunt semimartingales, L\'evy-type processes are exactly those for which the probabilistic symbol exists. Leaving quasi-continuity behind, one can construct processes admitting a symbol. However, we show, that the applicability of the symbol might be lost for these processes. Surprisingly, in our proofs the upper and lower Dini derivatives corresponding to certain singular functions play an important r\^ole.


title: Replacing Automatic Differentiation by Sobolev Cubatures fastens Physics Informed Neural Nets and strengthens their Approximation Power

abstract: We present a novel class of approximations for variational losses, being applicable for the training of physics-informed neural nets (PINNs). The loss formulation reflects classic Sobolev space theory for partial differential equations and their weak formulations. The loss computation rests on an extension of Gauss-Legendre cubatures, we term Sobolev cubatures, replacing automatic differentiation (A.D.). We prove the runtime complexity of training the resulting Soblev-PINNs (SC-PINNs) to be less than required by PINNs relying on A.D. On top of one-to-two order of magnitude speed-up the SC-PINNs are demonstrated to achieve closer solution approximations for prominent forward and inverse PDE problems than established PINNs achieve.


title: DAMO-YOLO : A Report on Real-Time Object Detection Design

abstract: In this report, we present a fast and accurate object detection method dubbed DAMO-YOLO, which achieves higher performance than the state-of-the-art YOLO series. DAMO-YOLO is extended from YOLO with some new technologies, including Neural Architecture Search (NAS), efficient Reparameterized Generalized-FPN (RepGFPN), a lightweight head with AlignedOTA label assignment, and distillation enhancement. In particular, we use MAE-NAS, a method guided by the principle of maximum entropy, to search our detection backbone under the constraints of low latency and high performance, producing ResNet/CSP-like structures with spatial pyramid pooling and focus modules. In the design of necks and heads, we follow the rule of ``large neck, small head''.We import Generalized-FPN with accelerated queen-fusion to build the detector neck and upgrade its CSPNet with efficient layer aggregation networks (ELAN) and reparameterization. Then we investigate how detector head size affects detection performance and find that a heavy neck with only one task projection layer would yield better results.In addition, AlignedOTA is proposed to solve the misalignment problem in label assignment. And a distillation schema is introduced to improve performance to a higher level. Based on these new techs, we build a suite of models at various scales to meet the needs of different scenarios. For general industry requirements, we propose DAMO-YOLO-T/S/M/L. They can achieve 43.6/47.7/50.2/51.9 mAPs on COCO with the latency of 2.78/3.83/5.62/7.95 ms on T4 GPUs respectively. Additionally, for edge devices with limited computing power, we have also proposed DAMO-YOLO-Ns/Nm/Nl lightweight models. They can achieve 32.3/38.2/40.5 mAPs on COCO with the latency of 4.08/5.05/6.69 ms on X86-CPU. Our proposed general and lightweight models have outperformed other YOLO series models in their respective application scenarios.


title: $\texttt{Davos}$: a Python "smuggler" for constructing lightweight reproducible notebooks

abstract: Reproducibility is a core requirement of modern scientific research. For computational research, reproducibility means that code should produce the same results, even when run on different systems. A standard approach to ensuring reproducibility entails packaging a project's dependencies along with its primary code base. Existing solutions vary in how deeply these dependencies are specified, ranging from virtual environments, to containers, to virtual machines. Each of these existing solutions requires installing or setting up a system for running the desired code, increasing the complexity and time cost of sharing or engaging with reproducible science. Here, we propose a lighter-weight solution: the $\texttt{Davos}$ package. When used in combination with a notebook-based Python project, $\texttt{Davos}$ provides a mechanism for specifying the correct versions of the project's dependencies directly within the code that requires them, and automatically installing them in an isolated environment when the code is run. The $\texttt{Davos}$ package further ensures that those packages and specific versions are used every time the notebook's code is executed. This enables researchers to share a complete reproducible copy of their code within a single Jupyter notebook file.


title: Global constraint on the magnitude of anomalous chiral effects in heavy-ion collisions

abstract: When searching for anomalous chiral effects in heavy-ion collisions, one of the most crucial points is the relationship between the signal and the background. In this letter, we present a simulation in a modified blast wave model at LHC energy, which can simultaneously characterize the majority of measurable quantities, in particular, the chiral magnetic effect (CME) and the chiral magnetic wave (CMW) observables. Such a universal description, for the first time, naturally and quantitatively unifies the CME and the CMW studies and brings to light the connection with the local charge conservation (LCC) background. Moreover, a simple phenomenological approach is performed to introduce the signals, aiming at quantifying the maximum allowable strength of the signals within experimental precision. Such a constraint provides a novel perspective to understand the experimental data and sheds new light on the study of anomalous chiral effects as well as charge dependent correlations.


title: Stationary time correlations for fermions after a quench in the presence of an impurity

abstract: We consider the quench dynamics of non-interacting fermions in one dimension in the presence of a finite-size impurity at the origin. This impurity is characterized by general momentum-dependent reflection and transmission coefficients which are changed from ${\sf r}_0(k), {\sf t}_0(k)$ to ${\sf r}(k), {\sf t}(k)$ at time $t=0$. The initial state is at equilibrium with ${\sf t}_0(k)=0$ such that the system is cut in two independent halves with ${\sf r}_0^R(k)$, ${\sf r}_0^L(k)$ respectively to the right and to the left of the impurity. We obtain the exact large time limit of the multi-time correlations. These correlations become time translationally invariant, and are non-zero in two different regimes: (i) for $x=O(1)$ where the system reaches a non-equilibrium steady state (NESS) (ii) for $x \sim t$, i.e., the ray-regime. For a repulsive impurity these correlations are independent of ${\sf r}_0^R(k)$, ${\sf r}_0^L(k)$, while in the presence of bound states they oscillate and memory effects persist. We show that these nontrivial relaxational properties can be retrieved in a simple manner from the large time behaviour of the single particle wave functions.


title: Bayesian approach to radio frequency interference mitigation

abstract: Interfering signals such as Radio Frequency Interference from ubiquitous satellite constellations are becoming an endemic problem in fields involving physical observations of the electromagnetic spectrum. To address this we propose a novel data cleaning methodology. Contamination is simultaneously flagged and managed at the likelihood level. It is modeled in a Bayesian fashion through a piecewise likelihood that is constrained by a Bernoulli prior distribution. The techniques described in this paper can be implemented with just a few lines of code.


title: Null controllability of damped nonlinear wave equation

abstract: In this paper, we study the null controllability of nonlinear wave systems. Firstly, by combing Gerlerkin method and a fixed point theorem, we give the null controllability for semi-linear wave equation with nonlinear function dependents on velocities under the geometric control condition. Secondly, based on a new iterative method, we prove the null controllability for a class of quasi-linear wave system constructively. Finally, we give a control result for a class of fully nonlinear wave system as application.


title: Comparing perspective reformulations for piecewise-convex optimization

abstract: Our study is motivated by the solution of Mixed-Integer Non-Linear Programming (MINLP) problems with separable non-convex functions via the Sequential Convex MINLP technique, an iterative method whose main characteristic is that of solving, for bounding purposes, piecewise-convex MINLP relaxations obtained by identifying the intervals in which each univariate function is convex or concave and then relaxing the concave parts with piecewise-linear relaxations of increasing precision. This process requires the introduction of new binary variables for the activation of the intervals where the functions are defined. In this paper we compare the three different standard formulations for the lower bounding subproblems and we show, both theoretically and computationally, that -- unlike in the piecewise-linear case -- they are not equivalent when the perspective reformulation is applied to reinforce the formulation in the segments where the original functions are convex.


title: Discovering Unsupervised Behaviours from Full-State Trajectories

abstract: Improving open-ended learning capabilities is a promising approach to enable robots to face the unbounded complexity of the real-world. Among existing methods, the ability of Quality-Diversity algorithms to generate large collections of diverse and high-performing skills is instrumental in this context. However, most of those algorithms rely on a hand-coded behavioural descriptor to characterise the diversity, hence requiring prior knowledge about the considered tasks. In this work, we propose an additional analysis of Autonomous Robots Realising their Abilities; a Quality-Diversity algorithm that autonomously finds behavioural characterisations. We evaluate this approach on a simulated robotic environment, where the robot has to autonomously discover its abilities from its full-state trajectories. All algorithms were applied to three tasks: navigation, moving forward with a high velocity, and performing half-rolls. The experimental results show that the algorithm under study discovers autonomously collections of solutions that are diverse with respect to all tasks. More specifically, the analysed approach autonomously finds policies that make the robot move to diverse positions, but also utilise its legs in diverse ways, and even perform half-rolls.


title: Structural Properties of Irreducible Two-Particle Representations of the Poincar\'e Group

abstract: Two particles, described by an irreducible two-particle representation of the Poincar\'e group, are correlated by the constraints that the constancy of the Casimir operators imposes on the state space. This correlation can be understood as a geometrically caused interaction between the particles, the strength of which is related to the normalisation constant $\omega$ of the two-particle states by $4\pi\,\omega^2$. The numerical value of $4\pi\,\omega^2$ is found to match the experimental value of the electromagnetic fine structure constant $\alpha$. This strongly suggests that the correlation of two particles in an irreducible two-particle representation of the Poincar\'e group manifests itself in the electromagnetic interaction.


title: An Alphabet of Leakage Measures

abstract: We introduce a family of information leakage measures called maximal $\alpha,\beta$-leakage, parameterized by real numbers $\alpha$ and $\beta$. The measure is formalized via an operational definition involving an adversary guessing an unknown function of the data given the released data. We obtain a simple, computable expression for the measure and show that it satisfies several basic properties such as monotonicity in $\beta$ for a fixed $\alpha$, non-negativity, data processing inequalities, and additivity over independent releases. Finally, we highlight the relevance of this family by showing that it bridges several known leakage measures, including maximal $\alpha$-leakage $(\beta=1)$, maximal leakage $(\alpha=\infty,\beta=1)$, local differential privacy $(\alpha=\infty,\beta=\infty)$, and local Renyi differential privacy $(\alpha=\beta)$.


title: AMY Lorentz invariant parton cascade -- the thermal equilibrium case

abstract: We introduce ALPACA, a Lorentz invariant parton cascade encoding the AMY effective kinetic theory of QCD at high temperatures. It solves the Boltzmann equation by explicitly simulating the evolution of parton ensembles corresponding to single events. We discuss how the effective masses and temperature entering the elastic collision and splitting/merging rates can be estimated from just a single event. We perform an extensive validation of the framework by showing that it reproduces the expected behaviour in thermal equilibrium.


title: Incompleteness and undecidability of theories consistent with $\mathsf{R}$

abstract: We prove the following version of the first incompleteness theorem that simultaneously strengthens Mostowski's theorem and Vaught's theorem: For any c.e. family $\{ T_i \}_{i \in \omega}$ of consistent extensions of Tarski, Mostowski and Robinson's arithmetic $\mathsf{R}$, there exists a sentence $\varphi$ of arithmetic such that $\varphi \vdash \mathsf{R}$ and for all $i \in \omega$, $T_i \nvdash \varphi$ and $T_i \nvdash \neg \varphi$.


title: Noise-resilient approach for deep tomographic imaging

abstract: We propose a noise-resilient deep reconstruction algorithm for X-ray tomography. Our approach shows strong noise resilience without obtaining noisy training examples. The advantages of our framework may further enable low-photon tomographic imaging.


title: Hypernetworks for Zero-shot Transfer in Reinforcement Learning

abstract: In this paper, hypernetworks are trained to generate behaviors across a range of unseen task conditions, via a novel TD-based training objective and data from a set of near-optimal RL solutions for training tasks. This work relates to meta RL, contextual RL, and transfer learning, with a particular focus on zero-shot performance at test time, enabled by knowledge of the task parameters (also known as context). Our technical approach is based upon viewing each RL algorithm as a mapping from the MDP specifics to the near-optimal value function and policy and seek to approximate it with a hypernetwork that can generate near-optimal value functions and policies, given the parameters of the MDP. We show that, under certain conditions, this mapping can be considered as a supervised learning problem. We empirically evaluate the effectiveness of our method for zero-shot transfer to new reward and transition dynamics on a series of continuous control tasks from DeepMind Control Suite. Our method demonstrates significant improvements over baselines from multitask and meta RL approaches.


title: Validating Large Language Models with ReLM

abstract: Although large language models (LLMs) have been touted for their ability to generate natural-sounding text, there are growing concerns around possible negative effects of LLMs such as data memorization, bias, and inappropriate language. Unfortunately, the complexity and generation capacities of LLMs make validating (and correcting) such concerns difficult. In this work, we introduce ReLM, a system for validating and querying LLMs using standard regular expressions. ReLM formalizes and enables a broad range of language model evaluations, reducing complex evaluation rules to simple regular expression queries. Our results exploring queries surrounding memorization, gender bias, toxicity, and language understanding show that ReLM achieves up to 15x higher system efficiency, 2.5x data efficiency, and increased statistical and prompt-tuning coverage compared to state-of-the-art ad-hoc queries. ReLM offers a competitive and general baseline for the increasingly important problem of LLM validation.


title: Classification of Human Monkeypox Disease Using Deep Learning Models and Attention Mechanisms

abstract: As the world is still trying to rebuild from the destruction caused by the widespread reach of the COVID-19 virus, and the recent alarming surge of human monkeypox disease outbreaks in numerous countries threatens to become a new global pandemic too. Human monkeypox disease syndromes are quite similar to chickenpox, and measles classic symptoms, with very intricate differences such as skin blisters, which come in diverse forms. Various deep-learning methods have shown promising performances in the image-based diagnosis of COVID-19, tumor cell, and skin disease classification tasks. In this paper, we try to integrate deep transfer-learning-based methods, along with a convolutional block attention module (CBAM), to focus on the relevant portion of the feature maps to conduct an image-based classification of human monkeypox disease. We implement five deep-learning models, VGG19, Xception, DenseNet121, EfficientNetB3, and MobileNetV2, along with integrated channel and spatial attention mechanisms, and perform a comparative analysis among them. An architecture consisting of Xception-CBAM-Dense layers performed better than the other models at classifying human monkeypox and other diseases with a validation accuracy of 83.89%.


title: Fragment-History Volumes

abstract: Hardware-based triangle rasterization is still the prevalent method for generating images at real-time interactive frame rates. With the availability of a programmable graphics pipeline a large variety of techniques are supported for evaluating lighting and material properties of fragments. However, these techniques are usually restricted to evaluating local lighting and material effects. In addition, view-point changes require the complete processing of scene data to generate appropriate images. Reusing already rendered data in the frame buffer for a given view point by warping for a new viewpoint increases navigation fidelity at the expense of introducing artifacts for fragments previously hidden from the viewer. We present fragment-history volumes (FHV), a rendering technique based on a sparse, discretized representation of a 3d scene that emerges from recording all fragments that pass the rasterization stage in the graphics pipeline. These fragments are stored into per-pixel or per-octant lists for further processing; essentially creating an A-buffer. FHVs using per-octant fragment lists are view independent and allow fast resampling for image generation as well as for using more sophisticated approaches to evaluate material and lighting properties, eventually enabling global-illumination evaluation in the standard graphics pipeline available on current hardware. We show how FHVs are stored on the GPU in several ways, how they are created, and how they can be used for image generation at high rates. We discuss results for different usage scenarios, variations of the technique, and some limitations.


title: An introduction to Thompson knot theory and to Jones subgroups

abstract: We review a constructions of knots from elements of the Thompson groups due to Vaughan Jones, which comes in two flavours: oriented and unoriented.


title: Investigating Prompt Engineering in Diffusion Models

abstract: With the spread of the use of Text2Img diffusion models such as DALL-E 2, Imagen, Mid Journey and Stable Diffusion, one challenge that artists face is selecting the right prompts to achieve the desired artistic output. We present techniques for measuring the effect that specific words and phrases in prompts have, and (in the Appendix) present guidance on the selection of prompts to produce desired effects.