title: Having Second Thoughts? Let's hear it

abstract: Deep learning models loosely mimic bottom-up signal pathways from low-order sensory areas to high-order cognitive areas. After training, DL models can outperform humans on some domain-specific tasks, but their decision-making process has been known to be easily disrupted. Since the human brain consists of multiple functional areas highly connected to one another and relies on intricate interplays between bottom-up and top-down (from high-order to low-order areas) processing, we hypothesize that incorporating top-down signal processing may make DL models more robust. To address this hypothesis, we propose a certification process mimicking selective attention and test if it could make DL models more robust. Our empirical evaluations suggest that this newly proposed certification can improve DL models' accuracy and help us build safety measures to alleviate their vulnerabilities with both artificial and natural adversarial examples.


title: Controlling Atom-Surface Scattering with Laser Assisted Quantum Reflection

abstract: In low energy atom-surface scattering, it is possible for the atom to be reflected in a region of attractive potential with no classical turning point. This phenomenon has come to be known as quantum reflection and it can reduce the sticking probability of atoms to surfaces, as well be used for atom trapping. We simulate the quantum reflection process in a one-dimensional model with a slow-moving atom moving in a Morse potential in the presence of an applied laser field. We show that in the case of laser-assisted quantum reflection, the laser field imparts additional momentum and kinetic energy to the atom. This results in a decreased distance of closest approach between the atom and surface. Our results show that the distance of closest approach and can be controlled through the timing and intensity of the laser pulse, which may result in enhanced sticking probability and/or reduced quantum reflection probability.


title: An optimised cuckoo-based discrete symbiotic organisms search strategy for tasks scheduling in cloud computing environment

abstract: Currently, the cloud computing paradigm is experiencing rapid growth as there is a shift from other distributed computing methods and traditional IT infrastructure towards it. Consequently, optimised task scheduling techniques have become crucial in managing the expanding cloud computing environment. In cloud computing, numerous tasks need to be scheduled on a limited number of diverse virtual machines to minimise the imbalance between the local and global search space; and optimise system utilisation. Task scheduling is a challenging problem known as NP-complete, which means that there is no exact solution, and we can only achieve near-optimal results, particularly when using large-scale tasks in the context of cloud computing. This paper proposes an optimised strategy, Cuckoo-based Discrete Symbiotic Organisms Search (C-DSOS) that incorporated with Levy-Flight for optimal task scheduling in the cloud computing environment to minimise degree of imbalance. The strategy is based on the Standard Symbiotic Organism Search (SOS), which is a nature-inspired metaheuristic optimisation algorithm designed for numerical optimisation problems. SOS simulates the symbiotic relationships observed in ecosystems, such as mutualism, commensalism, and parasitism. To evaluate the proposed technique, the CloudSim toolkit simulator was used to conduct experiments. The results demonstrated that C-DSOS outperforms the Simulated Annealing Symbiotic Organism Search (SASOS) algorithm, which is a benchmarked algorithm commonly used in task scheduling problems. C-DSOS exhibits a favourable convergence rate, especially when using larger search spaces, making it suitable for task scheduling problems in the cloud. For the analysis, a t-test was employed, reveals that C-DSOS is statistically significant compared to the benchmarked SASOS algorithm, particularly for scenarios involving a large search space.


title: Goodness-of-fit tests for the one-sided L\'evy distribution based on quantile conditional moments

abstract: In this paper we introduce a novel statistical framework based on the first two quantile conditional moments that facilitates effective goodness-of-fit testing for one-sided L\'evy distributions. The scale-ratio framework introduced in this paper extends our previous results in which we have shown how to extract unique distribution features using conditional variance ratio for the generic class of {\alpha}-stable distributions. We show that the conditional moment-based goodness-of-fit statistics are a good alternative to other methods introduced in the literature tailored to the one-sided L\'evy distributions. The usefulness of our approach is verified using an empirical test power study. For completeness, we also derive the asymptotic distributions of the test statistics and show how to apply our framework to real data.


title: Understanding the Utilization of Cryptocurrency in the Metaverse and Security Implications

abstract: We present our results on analyzing and understanding the behavior and security of various metaverse platforms incorporating cryptocurrencies. We obtained the top metaverse coins with a capitalization of at least 25 million US dollars and the top metaverse domains for the coins, and augmented our data with name registration information (via whois), including the hosting DNS IP addresses, registrant location, registrar URL, DNS service provider, expiry date and check each metaverse website for information on fiat currency for cryptocurrency. The result from virustotal.com includes the communication files, passive DNS, referrer files, and malicious detections for each metaverse domain. Among other insights, we discovered various incidents of malicious detection associated with metaverse websites. Our analysis highlights indicators of (in)security, in the correlation sense, with the files and other attributes that are potentially responsible for the malicious activities.


title: Ultra-Range Gesture Recognition using a Web-Camera in Human-Robot Interaction

abstract: Hand gestures play a significant role in human interactions where non-verbal intentions, thoughts and commands are conveyed. In Human-Robot Interaction (HRI), hand gestures offer a similar and efficient medium for conveying clear and rapid directives to a robotic agent. However, state-of-the-art vision-based methods for gesture recognition have been shown to be effective only up to a user-camera distance of seven meters. Such a short distance range limits practical HRI with, for example, service robots, search and rescue robots and drones. In this work, we address the Ultra-Range Gesture Recognition (URGR) problem by aiming for a recognition distance of up to 25 meters and in the context of HRI. We propose the URGR framework, a novel deep-learning, using solely a simple RGB camera. Gesture inference is based on a single image. First, a novel super-resolution model termed High-Quality Network (HQ-Net) uses a set of self-attention and convolutional layers to enhance the low-resolution image of the user. Then, we propose a novel URGR classifier termed Graph Vision Transformer (GViT) which takes the enhanced image as input. GViT combines the benefits of a Graph Convolutional Network (GCN) and a modified Vision Transformer (ViT). Evaluation of the proposed framework over diverse test data yields a high recognition rate of 98.1%. The framework has also exhibited superior performance compared to human recognition in ultra-range distances. With the framework, we analyze and demonstrate the performance of an autonomous quadruped robot directed by human gestures in complex ultra-range indoor and outdoor environments, acquiring 96% recognition rate on average.


title: Application of Process Mining and Sequence Clustering in Recognizing an Industrial Issue

abstract: Process mining has become one of the best programs that can outline the event logs of production processes in visualized detail. We have addressed the important problem that easily occurs in the industrial process called Bottleneck. The analysis process was focused on extracting the bottlenecks in the production line to improve the flow of production. Given enough stored history logs, the field of process mining can provide a suitable answer to optimize production flow by mitigating bottlenecks in the production stream. Process mining diagnoses the productivity processes by mining event logs, this can help to expose the opportunities to optimize critical production processes. We found that there is a considerable bottleneck in the process because of the weaving activities. Through discussions with specialists, it was agreed that the main problem in the weaving processes, especially machines that were exhausted in overloading processes. The improvement in the system has measured by teamwork; the cycle time for process has improved to 91%, the worker's performance has improved to 96%,product quality has improved by 85%, and lead time has optimized from days and weeks to hours.


title: The Infrastructure Utilization of Free Contents Websites Reveal their Security Characteristics

abstract: Free Content Websites (FCWs) are a significant element of the Web, and realizing their use is essential. This study analyzes FCWs worldwide by studying how they correlate with different network sizes, cloud service providers, and countries, depending on the type of content they offer. Additionally, we compare these findings with those of premium content websites (PCWs). Our analysis concluded that FCWs correlate mainly with networks of medium size, which are associated with a higher concentration of malicious websites. Moreover, we found a strong correlation between PCWs, cloud, and country hosting patterns. At the same time, some correlations were also observed concerning FCWs but with distinct patterns contrasting each other for both types. Our investigation contributes to comprehending the FCW ecosystem through correlation analysis, and the indicative results point toward controlling the potential risks caused by these sites through adequate segregation and filtering due to their concentration.


title: Status of Women in Astronomy: A need for advancing inclusivity and equal opportunities

abstract: Women in the Astronomy and STEM fields face systemic inequalities throughout their careers. Raising awareness, supported by detailed statistical data, represents the initial step toward closely monitoring hurdles in career progress and addressing underlying barriers to workplace equality. This, in turn, contributes to rectifying gender imbalances in STEM careers. The International Astronomical Union Women in Astronomy (IAU WiA) working group, a part of the IAU Executive Committee, is dedicated to increasing awareness of the status of women in Astronomy and supporting the aspirations of female astronomers globally. Its mission includes taking concrete actions to advance equal opportunities for both women and men in the field of astronomy. In August 2021, the IAU WiA Working Group established a new organizing committee, unveiling a comprehensive four-point plan. This plan aims to strengthen various aspects of the group's mission, encompassing: (i) Awareness Sustainability: Achieved through surveys and data collection, (ii) Training and Skill Building: Focused on professional development, (iii) Fundraising: To support key initiatives, and (iv) Communication: Dissemination of results through conferences, WG Magazines, newsletters, and more. This publication provides an overview of focused surveys that illuminate the factors influencing the careers of women in Astronomy, with a particular focus on the careers of mothers. It highlights the lack of inclusive policies, equal opportunities, and funding support for women researchers in the field. Finally, we summarize the specific initiatives undertaken by the IAU WiA Working Group to advance inclusivity and equal opportunities in Astronomy.

categories: astro-ph.IM astro-ph.CO astro-ph.EP astro-ph.GA astro-ph.HE astro-ph.SR


title: A convergence result of a continuous model of deep learning via \L{}ojasiewicz--Simon inequality

abstract: This study focuses on a Wasserstein-type gradient flow, which represents an optimization process of a continuous model of a Deep Neural Network (DNN). First, we establish the existence of a minimizer for an average loss of the model under $L^2$-regularization. Subsequently, we show the existence of a curve of maximal slope of the loss. Our main result is the convergence of flow to a critical point of the loss as time goes to infinity. An essential aspect of proving this result involves the establishment of the \L{}ojasiewicz--Simon gradient inequality for the loss. We derive this inequality by assuming the analyticity of NNs and loss functions. Our proofs offer a new approach for analyzing the asymptotic behavior of Wasserstein-type gradient flows for nonconvex functionals.


title: Untargeted Code Authorship Evasion with Seq2Seq Transformation

abstract: Code authorship attribution is the problem of identifying authors of programming language codes through the stylistic features in their codes, a topic that recently witnessed significant interest with outstanding performance. In this work, we present SCAE, a code authorship obfuscation technique that leverages a Seq2Seq code transformer called StructCoder. SCAE customizes StructCoder, a system designed initially for function-level code translation from one language to another (e.g., Java to C#), using transfer learning. SCAE improved the efficiency at a slight accuracy degradation compared to existing work. We also reduced the processing time by about 68% while maintaining an 85% transformation success rate and up to 95.77% evasion success rate in the untargeted setting.


title: BatchNorm-based Weakly Supervised Video Anomaly Detection

abstract: In weakly supervised video anomaly detection (WVAD), where only video-level labels indicating the presence or absence of abnormal events are available, the primary challenge arises from the inherent ambiguity in temporal annotations of abnormal occurrences. Inspired by the statistical insight that temporal features of abnormal events often exhibit outlier characteristics, we propose a novel method, BN-WVAD, which incorporates BatchNorm into WVAD. In the proposed BN-WVAD, we leverage the Divergence of Feature from Mean vector (DFM) of BatchNorm as a reliable abnormality criterion to discern potential abnormal snippets in abnormal videos. The proposed DFM criterion is also discriminative for anomaly recognition and more resilient to label noise, serving as the additional anomaly score to amend the prediction of the anomaly classifier that is susceptible to noisy labels. Moreover, a batch-level selection strategy is devised to filter more abnormal snippets in videos where more abnormal events occur. The proposed BN-WVAD model demonstrates state-of-the-art performance on UCF-Crime with an AUC of 87.24%, and XD-Violence, where AP reaches up to 84.93%. Our code implementation is accessible at https://github.com/cool-xuan/BN-WVAD.


title: Flow-Guided Diffusion for Video Inpainting

abstract: Video inpainting has been challenged by complex scenarios like large movements and low-light conditions. Current methods, including emerging diffusion models, face limitations in quality and efficiency. This paper introduces the Flow-Guided Diffusion model for Video Inpainting (FGDVI), a novel approach that significantly enhances temporal consistency and inpainting quality via reusing an off-the-shelf image generation diffusion model. We employ optical flow for precise one-step latent propagation and introduces a model-agnostic flow-guided latent interpolation technique. This technique expedites denoising, seamlessly integrating with any Video Diffusion Model (VDM) without additional training. Our FGDVI demonstrates a remarkable 10% improvement in flow warping error E_warp over existing state-of-the-art methods. Our comprehensive experiments validate superior performance of FGDVI, offering a promising direction for advanced video inpainting. The code and detailed results will be publicly available in https://github.com/NevSNev/FGDVI.


title: TD-Net: A Tri-domain network for sparse-view CT reconstruction

abstract: Sparse-view CT reconstruction, aimed at reducing X-ray radiation risks, frequently suffers from image quality degradation, manifested as noise and artifacts. Existing post-processing and dual-domain techniques, although effective in radiation reduction, often lead to over-smoothed results, compromising diagnostic clarity. Addressing this, we introduce TD-Net, a pioneering tri-domain approach that unifies sinogram, image, and frequency domain optimizations. By incorporating Frequency Supervision Module(FSM), TD-Net adeptly preserves intricate details, overcoming the prevalent over-smoothing issue. Extensive evaluations demonstrate TD-Net's superior performance in reconstructing high-quality CT images from sparse views, efficiently balancing radiation safety and image fidelity. The enhanced capabilities of TD-Net in varied noise scenarios highlight its potential as a breakthrough in medical imaging.

categories: eess.IV cs.AI cs.CV cs.LG physics.med-ph


title: Difference ascent sequences

abstract: Let alpha = a_1 a_2 ... a_n be a sequence of nonnegative integers. The ascent set of alpha, Asc(alpha), consists of all indices k where a_{k+1} > a_k. An ascent sequence is alpha where the growth of the a_k is bounded by the elements of Asc(alpha). These sequences were introduced by Bousquet-M\'elou, Claesson, Dukes and Kitaev and have many wonderful properties. In particular, they are in bijection with unlabeled (2+2)-free posets, permutations avoiding a particular bivincular pattern, certain upper-triangular nonnegative integer matrices, and a class of matchings. A weak ascent of alpha is an index k with a_{k+1} >= a_k and weak ascent sequences are defined analogously to ascent sequences. These were studied by B\'enyi, Claesson and Dukes and shown to have analogous equinumerous sets. Given a nonnegative integer d, we define a difference d ascent to be an index k such that a_{k+1} > a_k - d. We study the properties of the corresponding d-ascent sequences, showing that some of the maps from the weak case can be extended to bijections for general d while the extensions of others continue to be injective (but not surjective). We also make connections with other combinatorial objects such as rooted duplication trees and restricted growth functions.


title: From nonreciprocal to charge-4e supercurrents in Ge-based Josephson devices with tunable harmonic content

abstract: Hybrid superconductor(S)-semiconductor(Sm) devices bring a range of new functionalities into superconducting circuits. In particular, hybrid parity-protected qubits and Josephson diodes were recently proposed and experimentally demonstrated. Such devices leverage the non-sinusoidal character of the Josephson current-phase relation (CPR) in highly transparent S-Sm-S junctions. Here we report an experimental study of superconducting quantum-interference devices (SQUIDs) embedding Josephson field-effect transistors fabricated from a SiGe/Ge/SiGe heterostructure grown on a 200-mm silicon wafer. The single-junction CPR shows up to three harmonics with gate tunable amplitude. In the presence of microwave irradiation, the ratio of the first two dominant harmonics, corresponding to single and double Cooper-pair transport processes, is consistently reflected in relative weight of integer and half-integer Shapiro steps. A combination of magnetic-flux and gate-voltage control enables tuning the SQUID functionality from a nonreciprocal Josephson-diode regime with 27% asymmetry to a $\pi$-periodic Josephson regime suitable for the implementation of parity-protected superconducting qubits. These results illustrate the potential of Ge-based hybrid devices as versatile and scalable building blocks of novel superconducting quantum circuits.


title: Exploring Mid-Air Hand Interaction in Data Visualization

abstract: Interacting with data visualizations without an instrument or touch surface is typically characterized by the use of mid-air hand gestures. While mid-air expressions can be quite intuitive for interacting with digital content at a distance, they frequently lack precision and necessitate a different way of expressing users' data-related intentions. In this work, we aim to identify new designs for mid-air hand gesture manipulations that can facilitate instrument-free, touch-free, and embedded interactions with visualizations, while utilizing the three-dimensional (3D) interaction space that mid-air gestures afford. We explore mid-air hand gestures for data visualization by searching for natural means to interact with content. We employ three studies - an Elicitation Study, a User Study, and an Expert Study, to provide insight into the users' mental models, explore the design space, and suggest considerations for future mid-air hand gesture design. In addition to forming strong associations with physical manipulations, we discovered that mid-air hand gestures can: promote space-multiplexed interaction, which allows for a greater degree of expression; play a functional role in visual cognition and comprehension; and enhance creativity and engagement. We further highlight the challenges that designers in this field may face to help set the stage for developing effective gestures for a wide range of touchless interactions with visualizations.


title: Confidence Is All You Need for MI Attacks

abstract: In this evolving era of machine learning security, membership inference attacks have emerged as a potent threat to the confidentiality of sensitive data. In this attack, adversaries aim to determine whether a particular point was used during the training of a target model. This paper proposes a new method to gauge a data point's membership in a model's training set. Instead of correlating loss with membership, as is traditionally done, we have leveraged the fact that training examples generally exhibit higher confidence values when classified into their actual class. During training, the model is essentially being 'fit' to the training data and might face particular difficulties in generalization to unseen data. This asymmetry leads to the model achieving higher confidence on the training data as it exploits the specific patterns and noise present in the training data. Our proposed approach leverages the confidence values generated by the machine learning model. These confidence values provide a probabilistic measure of the model's certainty in its predictions and can further be used to infer the membership of a given data point. Additionally, we also introduce another variant of our method that allows us to carry out this attack without knowing the ground truth(true class) of a given data point, thus offering an edge over existing label-dependent attack methods.


title: Differentiability of the Value Function on $H^1(\Omega)$ of Semilinear Parabolic Infinite Time Horizon Optimal Control Problems under Control Constraints

abstract: An abstract framework guaranteeing the continuous differentiability of local value functions on $H^1(\Omega)$ associated with optimal stabilization problems subject to abstract semilinear parabolic equations in the presence of norm constraints on the control is established. It guarantees the local well-posedness of the associated Hamilton-Jacobi-Bellman equation in the classical sense. Examples illustrate that the assumptions imposed on the dynamical system are satisfied for practically relevant semilinear equations.


title: Embedded shear layers in turbulent boundary layers of a NACA0012 airfoil at high angles of attack

abstract: An investigation of turbulent boundary layers (TBLs) is presented for a NACA0012 airfoil at angles of attack 9 and 12 deg. Wall-resolved large eddy simulations (LES) are conducted for a freestream Mach number M = 0.2 and chord-based Reynolds number Re = 4x10^5, where the boundary layers are tripped near the airfoil leading edge on the suction side. For the angles of attack analyzed, mild, moderate and strong adverse pressure gradients (APGs) develop over the airfoil. Despite the strong APGs, the mean flow remains attached along the entire airfoil suction side. Similarly to other APG-TBLs investigated in the literature, a secondary peak appears in the Reynolds stress and turbulence production profiles. This secondary peak arises in the outer layer and, for strong APGs, it may overcome the first peak typically observed in the inner layer. The analysis of the turbulence production shows that other components of the production tensor become important in the outer layer besides the shear term. For moderate and strong APGs, the mean velocity profiles depict three inflexion points, the third being unstable under inviscid stability criteria. In this context, an embedded shear layer develops along the outer region of the TBL leading to the formation of two-dimensional rollers typical of a Kelvin-Helmholtz instability which are captured by a spectral proper orthogonal decomposition (SPOD) analysis. The most energetic SPOD spatial modes of the tangential velocity show that streaks form along the airfoil suction side and, as the APG becomes stronger, they grow along the spanwise and wall-normal directions, having a spatial support along the entire boundary layer.


title: Constructive validity of a generalized Kreisel-Putnam rule

abstract: In this paper, we propose a computational interpretation of the generalized Kreisel-Putnam rule, also known as the generalized Harrop rule or simply the Split rule, in the style of BHK semantics. We will achieve this by exploiting the Curry-Howard correspondence between formulas and types. First, we inspect the inferential behavior of the Split rule in the setting of a natural deduction system for the intuitionistic propositional logic. This will guide our process of formulating an appropriate program that would capture the corresponding computational content of the typed Split rule. In other words, we want to find an appropriate selector function for the Split rule by considering its typed variant. Our investigation can also be reframed as an effort to answer the following questions: is the Split rule constructively valid in the sense of BHK semantics? Our answer is positive for the Split rule as well as for its newly proposed generalized version called the S rule.


title: Increased Compute Efficiency and the Diffusion of AI Capabilities

abstract: Training advanced AI models requires large investments in computational resources, or compute. Yet, as hardware innovation reduces the price of compute and algorithmic advances make its use more efficient, the cost of training an AI model to a given performance falls over time - a concept we describe as increasing compute efficiency. We find that while an access effect increases the number of actors who can train models to a given performance over time, a performance effect simultaneously increases the performance available to each actor. This potentially enables large compute investors to pioneer new capabilities, maintaining a performance advantage even as capabilities diffuse. Since large compute investors tend to develop new capabilities first, it will be particularly important that they share information about their AI models, evaluate them for emerging risks, and, more generally, make responsible development and release decisions. Further, as compute efficiency increases, governments will need to prepare for a world where dangerous AI capabilities are widely available - for instance, by developing defenses against harmful AI models or by actively intervening in the diffusion of particularly dangerous capabilities.


title: Information gain limit of molecular computation

abstract: Molecular systems can convert between different steady-state probability distributions over system states, an operation that can be considered to be a computational step. Rather than converting between equilibrium steady-states at computational timepoints, biology uses chemical energy to access non-equilibrium steady-states, which require energy expenditure even when no computations are being performed. The information-theoretic advantage of this costly paradigm is poorly understood. Here we derive a concise expression relating the thermodynamic force to the information gain achievable in an arbitrary computational step. We show that information gain can be exponentially amplified by the thermodynamic force, explaining how incremental changes in inputs can generate qualitative changes in outputs, a defining characteristic of living systems. Numerical sampling demonstrates the tightness of this universal bound, and as examples, we show that Ras signaling and microtubule assembly can closely approach it. We anticipate this relation being used to determine whether particular molecular transformations are achievable.


title: Additive Model Perturbations Scaled by Physical Tendencies for Use in Ensemble Prediction

abstract: Imperfections and uncertainties in forecast models are often represented in ensemble prediction systems by stochastic perturbations of model equations. In this article, we present a new technique to generate model perturbations. The technique is termed Additive Model-uncertainty perturbations scaled by Physical Tendencies (AMPT). The generated perturbations are independent between different model variables and scaled by the local-area-averaged modulus of physical tendency. The previously developed Stochastic Pattern Generator is used to generate space and time-correlated pseudo-random fields. AMPT attempts to address some weak points of the popular model perturbation scheme known as Stochastically Perturbed Parametrization Tendencies (SPPT). Specifically, AMPT can produce non-zero perturbations even at grid points where the physical tendency is zero and avoids perfect correlations in the perturbation fields in the vertical and between different variables. Due to a non-local link from physical tendency to the local perturbation magnitude, AMPT can generate significantly greater perturbations than SPPT without causing instabilities. Relationships between biases and spreads caused by AMPT and SPPT were studied in an ensemble of forecasts. The non-hydrostatic, convection-permitting forecast model COSMO was used. In ensemble prediction experiments, AMPT perturbations led to statistically significant improvements (compared to SPPT) in probabilistic performance scores such as spread-skill relationship, CRPS, Brier Score, and ROC area for near-surface temperature. AMPT had similar but weaker effects on near-surface wind speed and mixed effects on precipitation.


title: Grafite: Taming Adversarial Queries with Optimal Range Filters

abstract: Range filters allow checking whether a query range intersects a given set of keys with a chance of returning a false positive answer, thus generalising the functionality of Bloom filters from point to range queries. Existing practical range filters have addressed this problem heuristically, resulting in high false positive rates and query times when dealing with adversarial inputs, such as in the common scenario where queries are correlated with the keys. We introduce Grafite, a novel range filter that solves these issues with a simple design and clear theoretical guarantees that hold regardless of the input data and query distribution: given a fixed space budget of $B$ bits per key, the query time is $O(1)$, and the false positive probability is upper bounded by $\ell/2^{B-2}$, where $\ell$ is the query range size. Our experimental evaluation shows that Grafite is the only range filter to date to achieve robust and predictable false positive rates across all combinations of datasets, query workloads, and range sizes, while providing faster queries and construction times, and dominating all competitors in the case of correlated queries. As a further contribution, we introduce a very simple heuristic range filter whose performance on uncorrelated queries is very close to or better than the one achieved by the best heuristic range filters proposed in the literature so far.


title: On universality of regular realizability problems

abstract: We prove universality of the regular realizability problems for several classes of filters. The filters are descriptions of finite relations on the set of non-negative integers in the format proposed by P. Wolf and H. Fernau. The universality has proven up to reductions using NP-oracles. It corresponds to the results of P. Wolf and H. Fernau about decidability of regular realizability problems for many graph-theoretic properties.


title: Evaluating Multi-Global Server Architecture for Federated Learning

abstract: Federated learning (FL) with a single global server framework is currently a popular approach for training machine learning models on decentralized environment, such as mobile devices and edge devices. However, the centralized server architecture poses a risk as any challenge on the central/global server would result in the failure of the entire system. To minimize this risk, we propose a novel federated learning framework that leverages the deployment of multiple global servers. We posit that implementing multiple global servers in federated learning can enhance efficiency by capitalizing on local collaborations and aggregating knowledge, and the error tolerance in regard to communication failure in the single server framework would be handled. We therefore propose a novel framework that leverages the deployment of multiple global servers. We conducted a series of experiments using a dataset containing the event history of electric vehicle (EV) charging at numerous stations. We deployed a federated learning setup with multiple global servers and client servers, where each client-server strategically represented a different region and a global server was responsible for aggregating local updates from those devices. Our preliminary results of the global models demonstrate that the difference in performance attributed to multiple servers is less than 1%. While the hypothesis of enhanced model efficiency was not as expected, the rule for handling communication challenges added to the algorithm could resolve the error tolerance issue. Future research can focus on identifying specific uses for the deployment of multiple global servers.


title: Visual Programming for Zero-shot Open-Vocabulary 3D Visual Grounding

abstract: 3D Visual Grounding (3DVG) aims at localizing 3D object based on textual descriptions. Conventional supervised methods for 3DVG often necessitate extensive annotations and a predefined vocabulary, which can be restrictive. To address this issue, we propose a novel visual programming approach for zero-shot open-vocabulary 3DVG, leveraging the capabilities of large language models (LLMs). Our approach begins with a unique dialog-based method, engaging with LLMs to establish a foundational understanding of zero-shot 3DVG. Building on this, we design a visual program that consists of three types of modules, i.e., view-independent, view-dependent, and functional modules. These modules, specifically tailored for 3D scenarios, work collaboratively to perform complex reasoning and inference. Furthermore, we develop an innovative language-object correlation module to extend the scope of existing 3D object detectors into open-vocabulary scenarios. Extensive experiments demonstrate that our zero-shot approach can outperform some supervised baselines, marking a significant stride towards effective 3DVG.


title: Robust and Automatic Data Clustering: Dirichlet Process meets Median-of-Means

abstract: Clustering stands as one of the most prominent challenges within the realm of unsupervised machine learning. Among the array of centroid-based clustering algorithms, the classic $k$-means algorithm, rooted in Lloyd's heuristic, takes center stage as one of the extensively employed techniques in the literature. Nonetheless, both $k$-means and its variants grapple with noteworthy limitations. These encompass a heavy reliance on initial cluster centroids, susceptibility to converging into local minima of the objective function, and sensitivity to outliers and noise in the data. When confronted with data containing noisy or outlier-laden observations, the Median-of-Means (MoM) estimator emerges as a stabilizing force for any centroid-based clustering framework. On a different note, a prevalent constraint among existing clustering methodologies resides in the prerequisite knowledge of the number of clusters prior to analysis. Utilizing model-based methodologies, such as Bayesian nonparametric models, offers the advantage of infinite mixture models, thereby circumventing the need for such requirements. Motivated by these facts, in this article, we present an efficient and automatic clustering technique by integrating the principles of model-based and centroid-based methodologies that mitigates the effect of noise on the quality of clustering while ensuring that the number of clusters need not be specified in advance. Statistical guarantees on the upper bound of clustering error, and rigorous assessment through simulated and real datasets suggest the advantages of our proposed method over existing state-of-the-art clustering algorithms.


title: Engineering Anomalously Large Electron Transport in Topological Semimetals

abstract: Anomalous transport of topological semimetals has generated significant interest for applications in optoelectronics, nanoscale devices, and interconnects. Understanding the origin of novel transport is crucial to engineering the desired material properties, yet their orders of magnitude higher transport than single-particle mobilities remain unexplained. This work demonstrates the dramatic mobility enhancements result from phonons primarily returning momentum to electrons due to phonon-electron dominating over phonon-phonon scattering. Proving this idea, proposed by Peierls in 1932, requires tuning electron and phonon dispersions without changing symmetry, topology, or disorder. This is achieved by combining de Haas - van Alphen (dHvA), electron transport, Raman scattering, and first-principles calculations in the topological semimetals MX$_2$ (M=Nb, Ta and X=Ge, Si). Replacing Ge with Si brings the transport mobilities from an order magnitude larger than single particle ones to nearly balanced. This occurs without changing the crystal structure or topology and with small differences in disorder or Fermi surface. Simultaneously, Raman scattering and first-principles calculations establish phonon-electron dominated scattering only in the MGe$_2$ compounds. Thus, this study proves that phonon-drag is crucial to the transport properties of topological semimetals and provides insight to further engineer these materials.


title: Spectro-ViT: A Vision Transformer Model for GABA-edited MRS Reconstruction Using Spectrograms

abstract: Purpose: To investigate the use of a Vision Transformer (ViT) to reconstruct/denoise GABA-edited magnetic resonance spectroscopy (MRS) from a quarter of the typically acquired number of transients using spectrograms. Theory and Methods: A quarter of the typically acquired number of transients collected in GABA-edited MRS scans are pre-processed and converted to a spectrogram image representation using the Short-Time Fourier Transform (STFT). The image representation of the data allows the adaptation of a pre-trained ViT for reconstructing GABA-edited MRS spectra (Spectro-ViT). The Spectro-ViT is fine-tuned and then tested using \textit{in vivo} GABA-edited MRS data. The Spectro-ViT performance is compared against other models in the literature using spectral quality metrics and estimated metabolite concentration values. Results: The Spectro-ViT model significantly outperformed all other models in four out of five quantitative metrics (mean squared error, shape score, GABA+/water fit error, and full width at half maximum). The metabolite concentrations estimated (GABA+/water, GABA+/Cr, and Glx/water) were consistent with the metabolite concentrations estimated using typical GABA-edited MRS scans reconstructed with the full amount of typically collected transients. Conclusion: The proposed Spectro-ViT model achieved state-of-the-art results in reconstructing GABA-edited MRS, and the results indicate these scans could be up to four times faster.


title: Micro-transfer-printed Thin film lithium niobate (TFLN)-on-Silicon Ring Modulator

abstract: Thin-film lithium niobate (TFLN) has a proven record of building high-performance electro-optical (EO) modulators. However, its CMOS incompatibility and the need for non-standard etching have consistently posed challenges in terms of scalability, standardization, and the complexity of integration. Heterogeneous integration comes to solve this key challenge. Micro-transfer printing of thin-film lithium niobate brings TFLN to well-established silicon ecosystem by easy "pick and place", which showcases immense potential in constructing high-density, cost-effective, highly versatile heterogeneous integrated circuits. Here, we demonstrated for the first time a micro-transfer-printed thin film lithium niobate (TFLN)-on-silicon ring modulator, which is an important step towards dense integration of performant lithium niobate modulators with compact and scalable silicon circuity. The presented device exhibits an insertion loss of -1.5dB, extinction ratio of -37dB, electro-optical bandwidth of 16GHz and modulation rates up to 45Gps.


title: Arndt compositions: a generating functions approach

abstract: We use generating functions to enumerate Arndt compositions, that is, integer compositions where there is a descent between every second pair of parts, starting with the first and second part, and so on. In 2013, J\"org Arndt noted that this family of compositions is counted by the Fibonacci sequence. We provide an approach that is purely based on generating functions to prove this observation. We also enumerate these compositions with respect to the number of parts and the last part. From this approach, we can generalize some recent results given by Hopkins and Tangboonduangjit in 2023. Finally, we study some possible generalizations of this counting problem.


title: Para-hydrogen based cold neutron source for simultaneous high flux and high brightness

abstract: A novel cold neutron source employing chess-board or staircase assemblies of high-aspect ratio rectangular \hpara moderators is proposed. It is demonstrated that this design can generate neutron beams with higher intensity and brightness, up to approximately 2.5 times more than any para-hydrogen-based cold neutron source with an equal cold neutron beam cross-section made of a single moderator (flat or voluminous). Two limiting factors for this gain are identified: the limited volume of the high-density thermal neutron region surrounding the reactor core or spallation target, which imposes constraints on the total length of the moderator assembly, and the finite width of moderator walls. Moreover, the relatively large length of moderator assemblies makes their application for short pulse neutron sources very problematic. An analytic approach for calculating the brightness of para-hydrogen moderators is introduced. Because brightness gain originates from a near-the-surface effect resulting from the prevailing single collision process during thermal-to-cold neutron conversion, high-aspect ratio rectangular cold moderators offer a significant increase, up to a factor of 10, in cold neutron brightness. The obtained results are in excellent agreement with MCNP calculations. The concept of 'low-dimensionality' in moderators is explored, demonstrating that achieving a substantial increase in brightness necessitates moderators to be low-dimensional both geometrically, implying a high aspect ratio, and physically, requiring the moderator's smallest dimension to be smaller than the characteristic scale of moderator medium (about the mean free path for thermal neutrons). This explains why additional compression of the moderator along the longest direction, effectively giving it a tube-like shape, does not result in a significant brightness increase comparable to the flattening of moderator.


title: Local Convergence of Approximate Newton Method for Two Layer Nonlinear Regression

abstract: There have been significant advancements made by large language models (LLMs) in various aspects of our daily lives. LLMs serve as a transformative force in natural language processing, finding applications in text generation, translation, sentiment analysis, and question-answering. The accomplishments of LLMs have led to a substantial increase in research efforts in this domain. One specific two-layer regression problem has been well-studied in prior works, where the first layer is activated by a ReLU unit, and the second layer is activated by a softmax unit. While previous works provide a solid analysis of building a two-layer regression, there is still a gap in the analysis of constructing regression problems with more than two layers. In this paper, we take a crucial step toward addressing this problem: we provide an analysis of a two-layer regression problem. In contrast to previous works, our first layer is activated by a softmax unit. This sets the stage for future analyses of creating more activation functions based on the softmax function. Rearranging the softmax function leads to significantly different analyses. Our main results involve analyzing the convergence properties of an approximate Newton method used to minimize the regularized training loss. We prove that the loss function for the Hessian matrix is positive definite and Lipschitz continuous under certain assumptions. This enables us to establish local convergence guarantees for the proposed training algorithm. Specifically, with an appropriate initialization and after $O(\log(1/\epsilon))$ iterations, our algorithm can find an $\epsilon$-approximate minimizer of the training loss with high probability. Each iteration requires approximately $O(\mathrm{nnz}(C) + d^\omega)$ time, where $d$ is the model size, $C$ is the input matrix, and $\omega < 2.374$ is the matrix multiplication exponent.


title: The Scale-Invariant Vacuum (SIV) Theory: A Possible Origin of Dark Matter and Dark Energy

abstract: The Scale Invariant Vacuum (SIV) theory rests on the basic hypothesis that the macroscopic empty space is scale invariant. This hypothesis is applied in the context of the Integrable Weyl Geometry, where it leads to considerable simplifications in the scale covariant cosmological equations. After an initial explosion and a phase of braking, the cosmological models show a continuous acceleration of the expansion. Several observational tests of the SIV cosmology are performed: on the relation between $H_0$ and the age of the Universe, on the $m-z$ diagram for SNIa data and its extension to $z=7$ with quasars and GRBs, and on the $H(z)$ vs. $z$ relation. All comparisons show a very good agreement between SIV predictions and observations. Predictions for the future observations of the redshift drifts are also given. In the weak field approximation, the equation of motion contains, in addition to the classical Newtonian term, an acceleration term (usually very small) depending on the velocity. The two-body problem is studied, showing a slow expansion of the classical conics. The new equation has been applied to clusters of galaxies, to rotating galaxies (some proximities with Modifies Newtonian Dynamics, MOND, are noticed), to the velocity dispersion vs. the age of the stars in the Milky Way, and to the growth of the density fluctuations in the Universe. We point out the similarity of the mechanical effects of the SIV hypothesis in cosmology and in the Newtonian approximation. In both cases, it results in an additional acceleration in the direction of motions. In cosmology, these effects are currently interpreted in terms of the dark energy hypothesis, while in the Newtonian approximation they are accounted for in terms of the dark matter (DM) hypothesis. These hypotheses appear no longer necessary in the SIV context.


title: Time-Varying Spaces and Mobile Sensor Networks

abstract: Consider a mobile sensor network, in which each sensor covers a ball. Sensors do not know their locations, but can detect if the covered balls overlap. An intruder cannot pass undetected between overlapping sensors. An evasion path exists if it is possible for an intruder to move in the domain without ever entering a covered region. We examine two time-varying topological spaces arising from such mobile sensor networks. These examples were constructed by Adams and Carlsson to show that the time-varying homotopy type of the covered region does not determine whether an evasion path exists or not. One of these spaces has an evasion path and the other does not, which means that the uncovered regions are not time-varying homotopy equivalent. We show that the covered regions of these spaces are not time-varying homeomorphic, even though they are time-varying homotopy equivalent. We then elaborate on this time-varying homotopy equivalence between the covered regions.


title: Half-Precision Kronecker Product SVD Preconditioner for Structured Inverse Problems

abstract: In this paper we investigate the use of half-precision Kronecker product singular value decomposition (SVD) approximations as preconditioners for large-scale Tikhonov regularized least squares problems. Half precision reduces storage requirements and has the potential to greatly speedup computations on certain GPU architectures. We consider both standard PCG and flexible PCG algorithms, and investigate, through numerical experiments on image deblurring problems, the trade-offs between potentially faster convergence with the additional cost per iteration when using this preconditioning approach. Moreover, we also investigate the use of several regularization parameter choice methods, including generalized cross validation and the discrepancy principle.


title: Natural Aging and Vacancy Trapping in Al-6xxx

abstract: Undesirable natural aging (NA) in Al-6xxx delays subsequent artificial aging (AA) but the size, composition, and evolution of clustering are challenging to measure. Here, atomistic details of early-stage clustering in Al-1\%Mg-0.6\%Si during NA are studied computationally using a chemically-accurate neural-network potential. Feasible growth paths for the preferred $\beta''$ precipitates identify: dominant clusters differing from $\beta''$ motifs; spontaneous vacancy-interstitial formation creating 14-18 solute atom $\beta''$-like motifs; and lower-energy clusters requiring chemical re-arrangement to form $\beta''$ nuclei. Quasi-on-lattice kinetic Monte Carlo simulations reveal that 8-14 solute atom clusters form within 1000 s but that growth slows considerably due to vacancy trapping inside clusters, with trapping energies of 0.3-0.5 eV. These findings rationalize why cluster growth and alloy hardness saturate during NA, confirm the concept of ''vacancy prisons", and suggest why clusters must be dissolved during AA before formation of $\beta''$. This atomistic understanding of NA may enable design of strategies to mitigate negative effects of NA.


title: ConstraintMatch for Semi-constrained Clustering

abstract: Constrained clustering allows the training of classification models using pairwise constraints only, which are weak and relatively easy to mine, while still yielding full-supervision-level model performance. While they perform well even in the absence of the true underlying class labels, constrained clustering models still require large amounts of binary constraint annotations for training. In this paper, we propose a semi-supervised context whereby a large amount of \textit{unconstrained} data is available alongside a smaller set of constraints, and propose \textit{ConstraintMatch} to leverage such unconstrained data. While a great deal of progress has been made in semi-supervised learning using full labels, there are a number of challenges that prevent a naive application of the resulting methods in the constraint-based label setting. Therefore, we reason about and analyze these challenges, specifically 1) proposing a \textit{pseudo-constraining} mechanism to overcome the confirmation bias, a major weakness of pseudo-labeling, 2) developing new methods for pseudo-labeling towards the selection of \textit{informative} unconstrained samples, 3) showing that this also allows the use of pairwise loss functions for the initial and auxiliary losses which facilitates semi-constrained model training. In extensive experiments, we demonstrate the effectiveness of ConstraintMatch over relevant baselines in both the regular clustering and overclustering scenarios on five challenging benchmarks and provide analyses of its several components.


title: EulerMerge: Simplifying Euler Diagrams Through Set Merges

abstract: Euler diagrams are an intuitive and popular method to visualize set-based data. In a Euler diagram, each set is represented as a closed curve, and set intersections are shown by curve overlaps. However, Euler diagrams are not visually scalable and automatic layout techniques struggle to display real-world data sets in a comprehensible way. Prior state-of-the-art approaches can embed Euler diagrams by splitting a closed curve into multiple curves so that a set is represented by multiple disconnected enclosed areas. In addition, these methods typically result in multiple curve segments being drawn concurrently. Both of these features significantly impede understanding. In this paper, we present a new and scalable method for embedding Euler diagrams using set merges. Our approach simplifies the underlying data to ensure that each set is represented by a single, connected enclosed area and that the diagram is drawn without curve concurrency, leading to well formed and understandable Euler diagrams.


title: Anosov contact metrics, Dirichlet optimization and entropy

abstract: The first main result of this paper classifies critical contact metrics on 3-manifolds, i.e. contact metrics which are critical points of the Dirichlet energy functional. This gives a complete answer to a question raised by Chern-Hamilton in 1984. Secondly, we show that in the case of Anosov contact metrics, the infimum of such energy functional is closely related to Reeb dynamics and can be described in terms of its entropy. We also record corollaries about the curvature of such contact metrics. A technical theorem on the expansion uniformization of Anosov 3-flows is also proved in the Appendix, which can be of broader interest.


title: On the Convergence of Learning Algorithms in Bayesian Auction Games

abstract: Equilibrium problems in Bayesian auction games can be described as systems of differential equations. Depending on the model assumptions, these equations might be such that we do not have a rigorous mathematical solution theory. The lack of analytical or numerical techniques with guaranteed convergence for the equilibrium problem has plagued the field and limited equilibrium analysis to rather simple auction models such as single-object auctions. Recent advances in equilibrium learning led to algorithms that find equilibrium under a wide variety of model assumptions. We analyze first- and second-price auctions where simple learning algorithms converge to an equilibrium. The equilibrium problem in auctions is equivalent to solving an infinite-dimensional variational inequality (VI). Monotonicity and the Minty condition are the central sufficient conditions for learning algorithms to converge to an equilibrium in such VIs. We show that neither monotonicity nor pseudo- or quasi-monotonicity holds for the respective VIs. The second-price auction's equilibrium is a Minty-type solution, but the first-price auction is not. However, the Bayes--Nash equilibrium is the unique solution to the VI within the class of uniformly increasing bid functions, which ensures that gradient-based algorithms attain the {equilibrium} in case of convergence, as also observed in numerical experiments.


title: Optimally Teaching a Linear Behavior Cloning Agent

abstract: We study optimal teaching of Linear Behavior Cloning (LBC) learners. In this setup, the teacher can select which states to demonstrate to an LBC learner. The learner maintains a version space of infinite linear hypotheses consistent with the demonstration. The goal of the teacher is to teach a realizable target policy to the learner using minimum number of state demonstrations. This number is known as the Teaching Dimension(TD). We present a teaching algorithm called ``Teach using Iterative Elimination(TIE)" that achieves instance optimal TD. However, we also show that finding optimal teaching set computationally is NP-hard. We further provide an approximation algorithm that guarantees an approximation ratio of $\log(|A|-1)$ on the teaching dimension. Finally, we provide experimental results to validate the efficiency and effectiveness of our algorithm.


title: A Framework for Realistic Simulation of Daily Human Activity

abstract: For social robots like Astro which interact with and adapt to the daily movements of users within the home, realistic simulation of human activity is needed for feature development and testing. This paper presents a framework for simulating daily human activity patterns in home environments at scale, supporting manual configurability of different personas or activity patterns, variation of activity timings, and testing on multiple home layouts. We introduce a method for specifying day-to-day variation in schedules and present a bidirectional constraint propagation algorithm for generating schedules from templates. We validate the expressive power of our framework through a use case scenario analysis and demonstrate that our method can be used to generate data closely resembling human behavior from three public datasets and a self-collected dataset. Our contribution supports systematic testing of social robot behaviors at scale, enables procedural generation of synthetic datasets of human movement in different households, and can help minimize bias in training data, leading to more robust and effective robots for home environments.


title: Advanced Techniques in Mortality Trend Estimation: Integrating Generalized Additive Models and Machine Learning to Evaluate the COVID-19 Impact

abstract: The last two centuries have seen a significant increase in life expectancy. Although past trends suggest that mortality will continue to decline in the future, uncertainty and instability about the development is greatly increased due to the ongoing COVID-19 pandemic. It is therefore of essential interest, particularly to annuity and life insurers, to predict the mortality of their members or policyholders with reliable accuracy. The goal of this study is to improve the state-of-the-art stochastic mortality models using machine learning techniques and generalize them to a multi-population model. Detailed cross-country results conducted for Finland, Germany, Italy, the Netherlands, and the United States show that the best forecasting performance is achieved by a generalized additive model that uses the framework of APC analysis. Based on this finding, trend forecasts of mortality rates as a measure of longevity are fulfilled for the future, given a range of COVID-19 scenarios, from mild to severe. Discussing and evaluating the plausibility of these scenarios, this study is useful for preparation, planning, and informed decision-making.


title: Learning Section Weights for Multi-Label Document Classification

abstract: Multi-label document classification is a traditional task in NLP. Compared to single-label classification, each document can be assigned multiple classes. This problem is crucially important in various domains, such as tagging scientific articles. Documents are often structured into several sections such as abstract and title. Current approaches treat different sections equally for multi-label classification. We argue that this is not a realistic assumption, leading to sub-optimal results. Instead, we propose a new method called Learning Section Weights (LSW), leveraging the contribution of each distinct section for multi-label classification. Via multiple feed-forward layers, LSW learns to assign weights to each section of, and incorporate the weights in the prediction. We demonstrate our approach on scientific articles. Experimental results on public (arXiv) and private (Elsevier) datasets confirm the superiority of LSW, compared to state-of-the-art multi-label document classification methods. In particular, LSW achieves a 1.3% improvement in terms of macro averaged F1-score while it achieves 1.3% in terms of macro averaged recall on the publicly available arXiv dataset.


title: Mirror symmetry and new approach to constructing orbifolds of Gepner models

abstract: Motivated by the principles of the conformal bootstrap, primarily the principle of Locality, simultaneously with the requirement of space-time supersymmetry, we reconsider constructions of compactified superstring models. Starting from requirements of space-time supersymmetry and mutual locality, we construct a complete set of physical fields of orbifolds of Gepner models. To technically implement this, we use spectral flow generators to construct all physical fields from the chiral primary fields. The set of these spectral flow operators forms a so-called admissible group $G_{adm}$, which defines a given orbifold. The action of these operators produces a collection of physical fields consistent with the action of supersymmetry generators. The selection of mutually local fields from this collection is carried out using the mirror group $G^*_{adm}$. The permutation of $G_{adm}$ and $G^*_{adm}$ replaces the original orbifold with a mirror one that satisfies the same conditions as the original one. This also implies that the resulting model is modular invariant.


title: Applying statistical learning theory to deep learning

abstract: Although statistical learning theory provides a robust framework to understand supervised learning, many theoretical aspects of deep learning remain unclear, in particular how different architectures may lead to inductive bias when trained using gradient based methods. The goal of these lectures is to provide an overview of some of the main questions that arise when attempting to understand deep learning from a learning theory perspective. After a brief reminder on statistical learning theory and stochastic optimization, we discuss implicit bias in the context of benign overfitting. We then move to a general description of the mirror descent algorithm, showing how we may go back and forth between a parameter space and the corresponding function space for a given learning problem, as well as how the geometry of the learning problem may be represented by a metric tensor. Building on this framework, we provide a detailed study of the implicit bias of gradient descent on linear diagonal networks for various regression tasks, showing how the loss function, scale of parameters at initialization and depth of the network may lead to various forms of implicit bias, in particular transitioning between kernel or feature learning.


title: Charged Higgs decay to $W^{\pm}$ and heavy neutral Higgs decaying into $\tau^+\tau^-$ in Georgi Machacek Model at LHC

abstract: The CMS collaboration at the Large Hadron Collider (LHC) searched for a charged Higgs boson, in the mass range of 300 to 700 GeV, decaying into a $W^{\pm}$ boson and a heavy neutral Higgs boson of mass $200$ GeV, which successively decays into a pair of tau leptons, in proton-proton collisions at $\sqrt{s} = 13$ TeV. In this letter, focusing on the Georgi-Machacek (GM) model, I discuss the parameter space, allowed by the theoretical and experimental constraints, for which the limits on this process obtained by the CMS can be accommodated. The study in this letter also shows that, for the choice of the parameters, the decay of the charged Higgs boson $H_3^{\pm}$ to $W^{\pm}$ and a heavy neutral Higgs boson H is preferred over the decay to any gauge boson and any other neutral or charged Higgs bosons. I also present the values of production cross-section times branching ratio for the decay of H to a pair of b-quarks at $\sqrt{s}=14$ TeV.


title: How to Optimize the Environmental Impact of Transformed NoSQL Schemas through a Multidimensional Cost Model?

abstract: The complexity of database systems has increased significantly along with the continuous growth of data, resulting in NoSQL systems and forcing Information Systems (IS) architects to constantly adapt their data models (i.e., the data structure of information stored in the database) and carefully choose the best option(s) for storing and managing data. In this context, we propose %in this paper an automatic global approach for leading data models' transformation process. This approach starts with the generation of all possible solutions. It then relies on a cost model that helps to compare these generated data models in a logical level to finally choose the best one for the given use case. This cost model integrates both data model and queries cost. It also takes into consideration the environmental impact of a data model as well as its financial and its time costs. This work presents for the first time a multidimensional cost model encompassing time, environmental and financial constraints, which compares data models leading to the choice of the optimal one for a given use case. In addition, a simulation for data model's transformation and cost computation has been developed based on our approach.


title: Revised ephemeris and orbital period derivative of the supersoft X-ray source CAL 87 based on 34 years of observations

abstract: In this study, we present an analysis of over 34 years of observational data from CAL 87, an eclipsing supersoft X-ray source. The primary aim of our study, which combines previously analysed measurements as well as unexplored publicly available datasets, is to examine the orbital period evolution of CAL 87. After meticulously and consistently determining the eclipse timings, we constructed an O$-$C (observed minus calculated) diagram using a total of 38 data points. Our results provide confirmation of a positive derivative in the system's orbital period, with a determined value of $\dot{P}=+ 8.18\pm1.46\times10^{-11}$ s/s. We observe a noticeable jitter in the eclipse timings and additionally identify a systematic delay in the X-ray eclipses compared to those observed in longer wavelengths. We discuss the interplay of the pertinent factors that could contribute to a positive period derivative and the inherent variability in the eclipses.


title: Techniques for learning sparse Pauli-Lindblad noise models

abstract: Error-mitigation techniques such as probabilistic error cancellation and zero-noise extrapolation benefit from accurate noise models. The sparse Pauli-Lindblad noise model is one of the most successful models for those applications. In existing implementations, the model decomposes into a series of simple Pauli channels with one- and two-local terms that follow the qubit topology. While the model has been shown to accurately capture the noise in contemporary superconducting quantum processors for error mitigation, it is important to consider higher-weight terms and effects beyond nearest-neighbor interactions. For such extended models to remain practical, however, we need to ensure that they can be learned efficiently. In this work we present new techniques that accomplish exactly this. We introduce twirling based on Pauli rotations, which enables us to automatically generate single-qubit learning correction sequences and reduce the number of unique fidelities that need to be learned. In addition, we propose a basis-selection strategy that leverages graph coloring and uniform covering arrays to minimize the number of learning bases. Taken together, these techniques ensure that the learning of the extended noise models remains efficient, despite their increased complexity.


title: A non-uniformly inner amenable group

abstract: We provide an example of two elementarily equivalent countable ICC groups $G$ and $H$ such that $G$ is amenable and $H$ is not inner amenable. As a result, we provide the first example of elementarily equivalent groups whose group von Neumann algebras are not elementarily equivalent, answering a question asked by many researchers.


title: A Comprehensive Analysis of HIV Treatment Efficacy in the ACTG 175 Trial Through Multiple-Endpoint Approaches

abstract: In the realm of medical research, the intricate interplay of epidemiological risk, genomic activity, adverse events, and clinical response necessitates a nuanced consideration of multiple variables. Clinical trials, designed to meticulously assess the efficacy and safety of interventions, routinely incorporate a diverse array of endpoints. While a primary endpoint is customary, supplemented by key secondary endpoints, the statistical significance is typically evaluated independently for each. To address the inherent challenges in studying multiple endpoints, diverse strategies, including composite endpoints and global testing, have been proposed. This work stands apart by focusing on the evaluation of a clinical trial, deviating from the conventional approach to underscore the efficacy of a multiple-endpoint procedure. A double-blind study was conducted to gauge the treatment efficacy in adults infected with human immunodeficiency virus type 1 (HIV-1), featuring CD4 cell counts ranging from 200 to 500 per cubic millimeter. A total of 2467 HIV-1-infected patients (43 percent without prior antiretroviral treatment) were randomly assigned to one of four daily regimens: 600 mg of zidovudine; 600 mg of zidovudine plus 400 mg of didanosine; 600 mg of zidovudine plus 2.25 mg of zalcitabine; or 400 mg of didanosine. The primary endpoint comprised a >50 percent decline in CD4 cell count, development of acquired immunodeficiency syndrome (AIDS), or death. This study sought to determine the efficacy and safety of zidovudine (AZT) versus didanosine (ddI), AZT plus ddI, and AZT plus zalcitabine (ddC) in preventing disease progression in HIV-infected patients with CD4 counts of 200-500 cells/mm3. By jointly considering all endpoints, the multiple-endpoints approach yields results of greater significance than a single-endpoint approach.


title: On long-term fatigue damage estimation for a floating offshore wind turbine using a surrogate model

abstract: This study is concerned with the estimation of long-term fatigue damage for a floating offshore wind turbine. With the ultimate goal of efficient evaluation of fatigue limit states for floating offshore wind turbine systems, a detailed computational framework is introduced and used to develop a surrogate model using Gaussian process regression. The surrogate model, at first, relies only on a small subset of representative sea states and, then, is supplemented by the evaluation of additional sea states that leads to efficient convergence and accurate prediction of fatigue damage. A 5-MW offshore wind turbine supported by a semi-submersible floating platform is selected to demonstrate the proposed framework. The fore-aft bending moment at the turbine tower base and the fairlead tension in the windward mooring line are used for evaluation. Metocean data provide information on joint statistics of the wind and wave along with their relative likelihoods for the installation site in the Mediterranean Sea, near the coast of Sicily. \textcolor{black}{A coupled frequency-domain model} provides needed power spectra for the desired response processes. The proposed approach offers an efficient and accurate alternative to the exhaustive evaluation of a larger number of sea states and, as such, avoids excessive response simulations.


title: Joint Antenna Selection and Power Allocation in Massive MIMO Systems with Cell Division Technique for MRT and ZF Precoding Schemes

abstract: One of the most important challenges in the fifth generation (5G) of telecommunication systems is the efficiency of energy and spectrum. Massive multiple-input multiple-output (MIMO) systems have been proposed by researchers to resolve existing challenges. In the proposed system model of this paper, there is a base station (BS) around which several users and an eavesdropper (EVA) are evenly distributed. The information transmitted between BS and users is disrupted by an EVA, which highlights the importance of secure transfer. This paper analyzes secure energy efficiency (EE) of a massive MIMO system, and its purpose is to maximize the secure EE of the system. Several scenarios are considered to evaluate achieving the desired goal. To maximize the secure EE, selecting optimal number of antennas and cell division methods are employed. Each of these two methods is applied in a system with the maximum ratio transmission (MRT) and the zero forcing (ZF) precodings, and then the problem is solved. Maximum transmission power and minimum secure rate for users insert limitations to the optimization problem. Channel state information (CSI) is generally imperfect for users in any method, while CSI of the EVA is considered perfect as the worst case. Four iterative algorithms are designed to provide numerical assessments. The first algorithm calculates the optimal power of users without utilizing existing methods, the second one is related to the cell division method, the third one is based on the strategy of selecting optimal number of antennas, and forth one is based on a hybrid strategy.


title: On the Cauchy problem for 3D Navier-Stokes helical vortex filament

abstract: This paper studies the Cauchy problem for a helical vortex filament evolving by the 3D incompressible Navier-Stokes equations. We prove global-in-time well-posedness and smoothing of solutions with initial vorticity concentrated on a helix. We provide a local-in-time well-posedness result for vortex filaments periodic in one spatial direction, and show that solutions with helical initial data preserve this symmetry. We follow the approach of [4], where the analogue local-in-time result has been obtained for closed vortex filaments in $\mathbb{R}^3$. Next, we apply local energy weak solutions theory with a novel estimate for helical functions in non-helical domains to uniquely extend the solutions globally in time. This is the first global-in-time well-posedness result for a vortex filament without size restriction and without vanishing swirl assumptions.


title: KOPPA: Improving Prompt-based Continual Learning with Key-Query Orthogonal Projection and Prototype-based One-Versus-All

abstract: Drawing inspiration from prompt tuning techniques applied to Large Language Models, recent methods based on pre-trained ViT networks have achieved remarkable results in the field of Continual Learning. Specifically, these approaches propose to maintain a set of prompts and allocate a subset of them to learn each task using a key-query matching strategy. However, they may encounter limitations when lacking control over the correlations between old task queries and keys of future tasks, the shift of features in the latent space, and the relative separation of latent vectors learned in independent tasks. In this work, we introduce a novel key-query learning strategy based on orthogonal projection, inspired by model-agnostic meta-learning, to enhance prompt matching efficiency and address the challenge of shifting features. Furthermore, we introduce a One-Versus-All (OVA) prototype-based component that enhances the classification head distinction. Experimental results on benchmark datasets demonstrate that our method empowers the model to achieve results surpassing those of current state-of-the-art approaches by a large margin of up to 20%.


title: GAN-Based LiDAR Intensity Simulation

abstract: Realistic vehicle sensor simulation is an important element in developing autonomous driving. As physics-based implementations of visual sensors like LiDAR are complex in practice, data-based approaches promise solutions. Using pairs of camera images and LiDAR scans from real test drives, GANs can be trained to translate between them. For this process, we contribute two additions. First, we exploit the camera images, acquiring segmentation data and dense depth maps as additional input for training. Second, we test the performance of the LiDAR simulation by testing how well an object detection network generalizes between real and synthetic point clouds to enable evaluation without ground truth point clouds. Combining both, we simulate LiDAR point clouds and demonstrate their realism.


title: Potential theory for nonlocal drift-diffusion equations

abstract: The purpose of this paper is to prove new fine regularity results for nonlocal drift-diffusion equations via pointwise potential estimates. Our analysis requires only minimal assumptions on the divergence free drift term, enabling us to include drifts of critical order belonging merely to BMO. In particular, our results allow to derive new estimates for the dissipative surface quasi-geostrophic equation.


title: Spectral Moment Formulae for $GL(3)\times GL(2)$ $L$-functions III: The Twisted Case

abstract: This is a sequel to our previous articles \cite{Kw23, Kw23a+}. In this work, we apply recent techniques that fall under the banner of `Period Reciprocity' to study moments of $GL(3)\times GL(2)$ $L$-functions in the non-archimedean aspects, with a view towards the `Twisted Moment Conjectures' formulated by CFKRS.


title: Atomic models of dense plasmas, applications and current challenges

abstract: Modeling plasmas in terms of atoms or ions is theoretically appealing for several reasons. When it is relevant, the notion of atom or ion in a plasma provides us with an interpretation scheme of the plasma's internal functioning. From the standpoint of quantitative estimation of plasma properties, atomic models of plasma allow to extend many theoretical tools of atomic physics to plasmas. This notably includes the statistical approaches to the detailed accounting for excited states, or the collisional-radiative modeling of non-equilibrium plasmas, which is based on the notion of atomic processes. In this paper, we focus on the challenges raised by the atomic modeling of dense, non-ideal plasmas. First we make a brief, non-exhaustive review of atomic models of plasmas, from ideal plasmas to strongly-coupled and pressure-ionized plasmas. We discuss the limitations of these models and pinpoint some open problems in the field of atomic modeling of plasmas. We then address the peculiarities of atomic processes in dense plasmas and point out some specific issues relative to the calculation of their cross-sections. In particular, we discuss the modeling of fluctuations, the accounting for channel mixing and collective phenomena in the photoabsorption, or the impact of pressure ionization on collisional processes.


title: Frobenius-Type Norms and Inner Products of Matrices and Linear Maps with Applications to Neural Network Training

abstract: The Frobenius norm is a frequent choice of norm for matrices. In particular, the underlying Frobenius inner product is typically used to evaluate the gradient of an objective with respect to matrix variable, such as those occuring in the training of neural networks. We provide a broader view on the Frobenius norm and inner product for linear maps or matrices, and establish their dependence on inner products in the domain and co-domain spaces. This shows that the classical Frobenius norm is merely one special element of a family of more general Frobenius-type norms. The significant extra freedom furnished by this realization can be used, among other things, to precondition neural network training.


title: Data-Driven Modelling for Harmonic Current Emission in Low-Voltage Grid Using MCReSANet with Interpretability Analysis

abstract: Even though the use of power electronics PE loads offers enhanced electrical energy conversion efficiency and control, they remain the primary sources of harmonics in grids. When diverse loads are connected in the distribution system, their interactions complicate establishing analytical models for the relationship between harmonic voltages and currents. To solve this, our paper presents a data-driven model using MCReSANet to construct the highly nonlinear between harmonic voltage and current. Two datasets from PCCs in Finland and Germany are utilized, which demonstrates that MCReSANet is capable of establishing accurate nonlinear mappings, even in the presence of various network characteristics for selected Finland and Germany datasets. The model built by MCReSANet can improve the MAE by 10% and 14% compared to the CNN, and by 8% and 17% compared to the MLP for both Finnish and German datasets, also showing much lower model uncertainty than others. This is a crucial prerequisite for more precise SHAP value-based feature importance analysis, which is a method for the model interpretability analysis in this paper. The results by feature importance analysis show the detailed relationships between each order of harmonic voltage and current in the distribution system. There is an interactive impact on each order of harmonic current, but some orders of harmonic voltages have a dominant influence on harmonic current emissions: positive sequence and zero sequence harmonics have the dominant importance in the Finnish and German networks, respectively, which conforms to the pattern of connected load types in two selected Finnish and German datasets. This paper enhances the potential for understanding and predicting harmonic current emissions by diverse PE loads in distribution systems, which is beneficial to more effective management for optimizing power quality in diverse grid environments.


title: Wired Perspectives: Multi-View Wire Art Embraces Generative AI

abstract: Creating multi-view wire art (MVWA), a static 3D sculpture with diverse interpretations from different viewpoints, is a complex task even for skilled artists. In response, we present DreamWire, an AI system enabling everyone to craft MVWA easily. Users express their vision through text prompts or scribbles, freeing them from intricate 3D wire organisation. Our approach synergises 3D B\'ezier curves, Prim's algorithm, and knowledge distillation from diffusion models or their variants (e.g., ControlNet). This blend enables the system to represent 3D wire art, ensuring spatial continuity and overcoming data scarcity. Extensive evaluation and analysis are conducted to shed insight on the inner workings of the proposed system, including the trade-off between connectivity and visual aesthetics.


title: Automated Ring-Diagram Framework for Classifying CP Invariants

abstract: In this study, we introduce a transformative, automated framework for classifying basis invariants in generic field theories. Utilising a novel ring-diagram methodology accompanied by the well-known Cayley-Hamilton theorem, our approach uniquely enables the identification of basic invariants and their CP-property characterisation. Critically, our framework also unveils previously concealed attributes of established techniques reliant on the Hilbert-Poincar\'e series and its associated Plethystic logarithm. This paradigm shift has broad implications for the deeper understanding and more accurate classification of CP invariants in generic field theories.


title: Machine Learning-based estimation and explainable artificial intelligence-supported interpretation of the critical temperature from magnetic ab initio Heusler alloys data

abstract: Machine Learning (ML) has impacted numerous areas of materials science, most prominently improving molecular simulations, where force fields were trained on previously relaxed structures. One natural next step is to predict material properties beyond structure. In this work, we investigate the applicability and explainability of ML methods in the use case of estimating the critical temperature for magnetic Heusler alloys calculated using ab initio methods determined materials-specific magnetic interactions and a subsequent Monte Carlo (MC) approach. We compare the performance of regression and classification models to predict the range of the critical temperature of given compounds without performing the MC calculations. Since the MC calculation requires computational resources in the same order of magnitude as the density-functional theory (DFT) calculation, it would be advantageous to replace either step with a less computationally intensive method such as ML. We discuss the necessity to generate the magnetic ab initio results to make a quantitative prediction of the critical temperature. We used state-of-the-art explainable artificial intelligence (XAI) methods to extract physical relations and deepen our understanding of patterns learned by our models from the examined data.


title: Affine linking number estimates for the number of times an observer sees a star

abstract: Affine linking numbers are the generalization of linking numbers to the case of nonzero homologous linked submanifolds. They were introduced by Rudyak and the first author who used them to study causality in globally hyperbolic spacetimes. In this paper we use affine linking numbers to estimate the number of times an observer sees light from a star, that is how many copies of the star do they see on the sky due to gravitational lensing.


title: Machine-Generated Text Detection using Deep Learning

abstract: Our research focuses on the crucial challenge of discerning text produced by Large Language Models (LLMs) from human-generated text, which holds significance for various applications. With ongoing discussions about attaining a model with such functionality, we present supporting evidence regarding the feasibility of such models. We evaluated our models on multiple datasets, including Twitter Sentiment, Football Commentary, Project Gutenberg, PubMedQA, and SQuAD, confirming the efficacy of the enhanced detection approaches. These datasets were sampled with intricate constraints encompassing every possibility, laying the foundation for future research. We evaluate GPT-3.5-Turbo against various detectors such as SVM, RoBERTa-base, and RoBERTa-large. Based on the research findings, the results predominantly relied on the sequence length of the sentence.


title: Data Augmentation for Sample Efficient and Robust Document Ranking

abstract: Contextual ranking models have delivered impressive performance improvements over classical models in the document ranking task. However, these highly over-parameterized models tend to be data-hungry and require large amounts of data even for fine-tuning. In this paper, we propose data-augmentation methods for effective and robust ranking performance. One of the key benefits of using data augmentation is in achieving sample efficiency or learning effectively when we have only a small amount of training data. We propose supervised and unsupervised data augmentation schemes by creating training data using parts of the relevant documents in the query-document pairs. We then adapt a family of contrastive losses for the document ranking task that can exploit the augmented data to learn an effective ranking model. Our extensive experiments on subsets of the MS MARCO and TREC-DL test sets show that data augmentation, along with the ranking-adapted contrastive losses, results in performance improvements under most dataset sizes. Apart from sample efficiency, we conclusively show that data augmentation results in robust models when transferred to out-of-domain benchmarks. Our performance improvements in in-domain and more prominently in out-of-domain benchmarks show that augmentation regularizes the ranking model and improves its robustness and generalization capability.


title: Lived experiences of online harm amongst marginalized and vulnerable individuals in support-seeking communities on Reddit

abstract: Online communities can serve as meaningful sources of social support, particularly for marginalized and vulnerable groups. Disclosure of personal information facilitates integration into online communities but may also expose individuals to harm, including cyberbullying and manipulation. To better understand negative user experiences resulting from self-disclosure in online conversations, we interviewed 25 participants from target populations on Reddit. Through thematic analysis, we outline the harm they experience, including damage to self- and group identities. We find that encountering online harm can worsen offline adversity. We discuss how users protect themselves and recover from harm in the context of current platform affordances, highlighting ongoing challenges. Finally, we explore design implications for a community-driven, bottom-up approach to enhance user well-being and safety.


title: The Pickup and Delivery Problem with Crossdock for Perishable Goods

abstract: Our work departs from the original definition of the Pickup and Delivery Problem (PDP) and extends it by considering an interchange point (crossdock) where vehicles can exchange their goods with other vehicles in order to shorten their delivery routes and reduce their running times. Multiple operational constraints, such as time windows, vehicle capacities, and the synchronization of vehicles at the crossdock, are considered. In addition, the specific requirements of perishable goods, which should not be carried on long trips, are taken into account. Given this consideration, this study introduces the Pickup and Delivery Problem with Crossdock for Perishable Goods (PDPCDPG) and models it as a nonlinear programming problem. PDPCDPG is then reformulated to a MILP with the use of linearizations and its search space is tightened with the addition of valid inequalities that are employed when solving the problem to global optimality with Branch-and-Cut. Various computational experiments are conducted on benchmark instances found in the literature to assess the performance of our model. The results demonstrate the solution stability of the proposed approach. The proposed model aims to provide a practical and effective approach for transportation and logistics companies dealing with time-sensitive deliveries.


title: Fast calculation of retarded potentials in multi-domain TDDFT

abstract: A formulation for the efficient calculation of the electromagnetic retarded potential generated by time-dependent electron density in the context of real-time time dependent density functional theory (RT-TDDFT) is presented. The electron density is considered to be spatially separable, which is suitable for systems that include several molecules or nano-particles. The formulation is based on splitting the domain of interest into sub-domains and calculating the time dependent retarded potentials from each sub-domain separately. The computations are accelerated by using the fast Fourier transform and parallelization. We demonstrate this formulation by solving the orbitals dynamics in systems of two molecules at varied distances. We first show that for small distances we get exactly the results that are expected from non-retarded potentials, we then show that for large distances between sub-domains we observe substantial retardation effects.


title: Application of batch learning for boosting high-throughput ab initio success rates and reducing computational effort required using data-driven processes

abstract: The increased availability of computing time, in recent years, allows for systematic high-throughput studies of material classes with the purpose of both screening for materials with remarkable properties and understanding how structural configuration and material composition affect macroscopic attributes manifestation. However, when conducting systematic high-throughput studies, the individual ab initio calculations' success depends on the quality of the chosen input quantities. On a large scale, improving input parameters by trial and error is neither efficient nor systematic. We present a systematic, high-throughput compatible, and machine learning-based approach to improve the input parameters optimized during a DFT computation or workflow. This approach of integrating machine learning into a typical high-throughput workflow demonstrates the advantages and necessary considerations for a systematic study of magnetic multilayers of 3$d$ transition metal layers on FCC noble metal substrates. For 6660 film systems, we were able to improve the overall success rate of our high-throughput FLAPW-based structural relaxations from $64.8 \%$ to $94.3\ \%$ while at the same time requiring $17\ \%$ less computational time for each successful relaxation.


title: On the piecewise complexity of words and periodic words

abstract: The piecewise complexity $h(u)$ of a word is the minimal length of subwords needed to exactly characterise $u$. Its piecewise minimality index $\rho(u)$ is the smallest length $k$ such that $u$ is minimal among its order-$k$ class $[u]_k$ in Simon's congruence. We study these two measures and provide efficient algorithms for computing $h(u)$ and $\rho(u)$. We also provide efficient algorithms for the case where $u$ is a periodic word, of the form $u=v^n$


title: The Importance of Collective Privacy in Digital Sexual and Reproductive Health

abstract: There is an abundance of digital sexual and reproductive health technologies that presents a concern regarding their potential sensitive data breaches. We analyzed 15 Internet of Things (IoT) devices with sexual and reproductive tracking services and found this ever-extending collection of data implicates many beyond the individual including partner, child, and family. Results suggest that digital sexual and reproductive health data privacy is both an individual and collective endeavor.


title: An End-to-End Performance Comparison of Seven Permissioned Blockchain Systems

abstract: The emergence of more and more blockchain solutions with innovative approaches to optimising performance, scalability, privacy and governance complicates performance analysis. Reasons for the difficulty of benchmarking blockchains include, for example, the high number of system parameters to configure and the effort to deploy a blockchain network. In addition, performance data, which mostly comes from system vendors, is often intransparent. We investigate and evaluate the performance of seven permissioned blockchain systems using different parameter settings in a reproducible manner. We employ an end-to-end approach, where the clients sending the transactions are fully involved in the data collection approach. Our results highlight the peculiarities and limitations of the systems under investigation. Due to the insights given, our work forms the basis for continued research to optimise the performance of blockchain systems.


title: Structural Discovery with Partial Ordering Information for Time-Dependent Data with Convergence Guarantees

abstract: Structural discovery amongst a set of variables is of interest in both static and dynamic settings. In the presence of lead-lag dependencies in the data, the dynamics of the system can be represented through a structural equation model (SEM) that simultaneously captures the contemporaneous and temporal relationships amongst the variables, with the former encoded through a directed acyclic graph (DAG) for model identification. In many real applications, a partial ordering amongst the nodes of the DAG is available, which makes it either beneficial or imperative to incorporate it as a constraint in the problem formulation. This paper develops an algorithm that can seamlessly incorporate a priori partial ordering information for solving a linear SEM (also known as Structural Vector Autoregression) under a high-dimensional setting. The proposed algorithm is provably convergent to a stationary point, and exhibits competitive performance on both synthetic and real data sets.


title: Functional Diffusion

abstract: We propose a new class of generative diffusion models, called functional diffusion. In contrast to previous work, functional diffusion works on samples that are represented by functions with a continuous domain. Functional diffusion can be seen as an extension of classical diffusion models to an infinite-dimensional domain. Functional diffusion is very versatile as images, videos, audio, 3D shapes, deformations, \etc, can be handled by the same framework with minimal changes. In addition, functional diffusion is especially suited for irregular data or data defined in non-standard domains. In our work, we derive the necessary foundations for functional diffusion and propose a first implementation based on the transformer architecture. We show generative results on complicated signed distance functions and deformation functions defined on 3D surfaces.


title: Learning to Skip for Language Modeling

abstract: Overparameterized large-scale language models have impressive generalization performance of in-context few-shot learning. However, most language models allocate the same amount of parameters or computation to each token, disregarding the complexity or importance of the input data. We argue that in language model pretraining, a variable amount of computation should be assigned to different tokens, and this can be efficiently achieved via a simple routing mechanism. Different from conventional early stopping techniques where tokens can early exit at only early layers, we propose a more general method that dynamically skips the execution of a layer (or module) for any input token with a binary router. In our extensive evaluation across 24 NLP tasks, we demonstrate that the proposed method can significantly improve the 1-shot performance compared to other competitive baselines only at mild extra cost for inference.


title: Quality Modeling Under A Relaxed Natural Scene Statistics Model

abstract: Information-theoretic image quality assessment (IQA) models such as Visual Information Fidelity (VIF) and Spatio-temporal Reduced Reference Entropic Differences (ST-RRED) have enjoyed great success by seamlessly integrating natural scene statistics (NSS) with information theory. The Gaussian Scale Mixture (GSM) model that governs the wavelet subband coefficients of natural images forms the foundation for these algorithms. However, the explosion of user-generated content on social media, which is typically distorted by one or more of many possible unknown impairments, has revealed the limitations of NSS-based IQA models that rely on the simple GSM model. Here, we seek to elaborate the VIF index by deriving useful properties of the Multivariate Generalized Gaussian Distribution (MGGD), and using them to study the behavior of VIF under a Generalized GSM (GGSM) model.