title: Efficient computation of the super-sample covariance for stage IV galaxy surveys

abstract: Super-sample covariance (SSC) is an important effect for cosmological analyses that use the deep structure of the cosmic web; it may, however, be nontrivial to include it practically in a pipeline. We solve this difficulty by presenting a formula for the precision (inverse covariance) matrix and show applications to update likelihood or Fisher forecast pipelines. The formula has several advantages in terms of speed, reliability, stability, and ease of implementation. We present an analytical application to show the formal equivalence between three approaches to SSC: (i) at the usual covariance level, (ii) at the likelihood level, and (iii) with a quadratic estimator. We then present an application of this computationally efficient framework for studying the impact of inaccurate modelling of SSC responses for cosmological constraints from stage IV surveys. We find that a weak-lensing-only analysis is very sensitive to inaccurate modelling of the scale dependence of the response, which needs to be calibrated at the $\sim15\%$ level. The sensitivity to this scale dependence is less severe for the joint weak-lensing and galaxy clustering analysis (also known as 3x2pt). Nevertheless, we find that both the amplitude and scale-dependence of the responses have to be calibrated at better than 30\%.


title: StacerBot: A Stacktrace Search Engine for Stack Overflow

abstract: We as software developers or researchers very often get stacktrace error messages while we are trying to write some code or install some packages. Many times these error messages are very obscure and verbose; do not make much sense to us. There is a good chance that someone else has also faced similar issues probably shared similar stacktrace in various online developers' forums. However traditional google searches or other search engines are not very helpful to find web pages with similar stacktraces. In order to address this problem, we have developed a web interface; a better search engine: as an outcome of this research project where users can find appropriate stack overflow posts by submitting the whole stacktrace error message. The current developed solution can serve real-time parallel user queries with top-matched stack overflow posts within 50 seconds using a server with 300GB RAM. This study provides a comprehensive overview of the NLP techniques used in this study and an extensive overview of the research pipeline. This comprehensive result, limitations, and computational overhead mentioned in this study can be used by future researchers and software developers to build a better solution for this same problem or similar large-scale text matching-related tasks.


title: Clarifying Physical Properties of Magnetic Fields in Sunspots

abstract: We demonstrate that the radial magnetic-field component at the outer boundary of the sunspot penumbra is about 550 Mx cm$^{-2}$ independent of the sunspot area and the maximum magnetic field in the umbra. The mean magnetic-field intensity in sunspots grows slightly as the sunspot area increases up to 500 -- 1000 millionth of visual hemisphere (m.v.h.) and may reach about 900 -- 2000 Mx cm$^{-2}$. The total magnetic flux weakly depends on the maximum field strength in a sunspot and is determined by the spottedness, i.e. the sunspot number and the total sunspot area; however, the relation between the total flux and the sunspot area is substantially nonlinear. We suggest an explicit parametrization for this relation. The contribution of the magnetic flux associated with sunspots to the total magnetic flux is small, not achieving more than 20% even at the maximum of the solar activity.


title: Laboratory Demonstration of Optimal Identification and Control of Tip-Tilt Systems

abstract: We present the results of testing optimal linear-quadratic-Gaussian (LQG) control for tip and tilt Zernike wavefront modes on the SEAL (Santa cruz Extreme AO Lab) testbed. The controller employs a physics model conditioned by the expected tip/tilt power spectrum and vibration peaks. The model builds on similar implementations, such as that of the Gemini Planet Imager, by considering the effects of loop delays and the response of the control hardware. Tests are being performed on SEAL using the Fast Atmospheric Self-coherent camera Technique (FAST), and being executed using a custom Python library to align optics, generate interaction matrices, and perform real-time control by combining controllers with simulated disturbance signals to be corrected. We have carried out open-loop data collection, characterizing the natural bench dynamics, and have shown a reduction in RMS wavefront error due to integrator control and LQG control.


title: Centralizer clones relative to a strong limit cardinal

abstract: The notion of commutation of operations in universal algebra leads to the concept of centralizer clone and gives rise to a well-known class of problems that we call centralizer problems, in which one seeks to determine whether a given set of operations arises as a centralizer or, equivalently, coincides with its own double centralizer. Centralizer clones and centralizer problems in universal algebra have been studied by several authors, with early contributions by Cohn, Kuznecov, Danil'\v{c}enko, and Harnau. In this paper, we work within a generalized setting of infinitary universal algebra relative to a regular cardinal $\alpha$, thus allowing operations whose arities are sets of cardinality less than $\alpha$, and we study a notion of centralizer clone that is defined relative to $\alpha$. In this setting, we establish several new characterizations of centralizer clones and double centralizer clones, with special attention to the case in which $\alpha$ is a strong limit cardinal, and we discuss how these results enable a novel method for treating centralizer problems. We apply these results to establish positive solutions to finitary and infinitary centralizer problems for several specific classes of algebraic structures, including vector spaces, free actions of a group, and free actions of a free monoid.


title: View-Invariant Localization using Semantic Objects in Changing Environments

abstract: This paper proposes a novel framework for real-time localization and egomotion tracking of a vehicle in a reference map. The core idea is to map the semantic objects observed by the vehicle and register them to their corresponding objects in the reference map. While several recent works have leveraged semantic information for cross-view localization, the main contribution of this work is a view-invariant formulation that makes the approach directly applicable to any viewpoint configuration for which objects are detectable. Another distinctive feature is robustness to changes in the environment/objects due to a data association scheme suited for extreme outlier regimes (e.g., 90% association outliers). To demonstrate our framework, we consider an example of localizing a ground vehicle in a reference object map using only cars as objects. While only a stereo camera is used for the ground vehicle, we consider reference maps constructed a priori from ground viewpoints using stereo cameras and Lidar scans, and georeferenced aerial images captured at a different date to demonstrate the framework's robustness to different modalities, viewpoints, and environment changes. Evaluations on the KITTI dataset show that over a 3.7 km trajectory, localization occurs in 36 sec and is followed by real-time egomotion tracking with an average position error of 8.5 m in a Lidar reference map, and on an aerial object map where 77% of objects are outliers, localization is achieved in 71 sec with an average position error of 7.9 m.


title: Dynamic Beam-Based Random Access Scheme for M2M Communications in Massive MIMO Systems

abstract: Internet of things, supported by machine-to-machine (M2M) communications, is one of the most important applications for future 6th generation (6G) systems. A major challenge facing by 6G is enabling a massive number of M2M devices to access networks in a timely manner. Therefore, this paper exploits the spatial selectivity of massive multi-input multi-output (MIMO) to reduce the collision issue when massive M2M devices initiate random access simultaneously. In particular, a beam-based random access protocol is first proposed to make efficient use of the limited uplink resources for massive M2M devices. To address the non-uniform distribution of M2M devices in the space and time dimensions, an Markov decision process (MDP) problem with the objective of minimizing the average access delay is then formulated. Next, we present a dynamic beam-based access scheme based on the double deep Q network (DDQN) algorithm to solve the optimal policy. Finally, simulations are conducted to demonstrate the effectiveness of the proposed scheme including the model training and random access performance.


title: On Pidduck polynomials and zeros of the Riemann zeta function

abstract: For $1<p<\infty$, we prove that a necessary and sufficient condition for $s$ to be a zero of the Riemann zeta function in the strip $0<\Re s<1$ is that $$\left(\begin{array}{cccccc} 1 & \frac{1}{3} & \frac{1}{5} & \frac{1}{7} & \frac{1}{9} & \cdots \\ -\frac{s}{3} & 1 & \frac{1}{3} & \frac{1}{5} & \frac{1}{7} & \cdots \\ -\frac{s}{5} & -\frac{s}{5} & 1 & \frac{1}{3} & \frac{1}{5} & \cdots \\ -\frac{s}{7} &-\frac{s}{7} & -\frac{s}{7} & 1 & \frac{1}{3} & \cdots \\ -\frac{s}{9} & -\frac{s}{9} & -\frac{s}{9} & -\frac{s}{9} & 1 & \cdots \\ \vdots &\vdots & \vdots &\vdots & \vdots & \ddots\\ \end{array}\right)\left(\begin{array}{c} v_0 \\ v_1 \\ v_2 \\ v_3 \\ v_4 \\ \vdots \\ \vdots \\ \end{array}\right) =0 $$ has a nontrivial solution $\left(v_{k}\right)_{k=0}^\infty$ in $\ell^p$. A similar matrix equation was discovered by K. M. Ball in 2017, but the current paper offers a different (and independent) perspective. In this paper an explicit formula for $v_{k}$ is constructed in terms of Pidduck polynomials. In the process, it is also shown that Pidduck polynomials form an orthogonal basis with respect to an inner product of polynomials $f,g$ whereby we replace in a formal expression "$\sum_{n=1}^\infty (-1)^{n+1}n \overline{f(n^2)} g(n^2)$" the divergent sums "$\sum_{n=1}^\infty (-1)^{n+1}n^{1+2k}$" with their zeta-function regularized values. We also discuss the modification for possible non-simple zeros and conclude with applications to the question of the simplicity of the zeros and a relation to the Hilbert-P\'olya program.


title: Efficient parameterized algorithms on graphs with heterogeneous structure: Combining tree-depth and modular-width

abstract: Many computational problems admit fast algorithms on special inputs, however, the required properties might be quite restrictive. E.g., many graph problems can be solved much faster on interval or cographs, or on graphs of small modular-width or small tree-width, than on general graphs. One challenge is to attain the greatest generality of such results, i.e., being applicable to less restrictive input classes, without losing much in terms of running time. Building on the use of algebraic expressions we present a clean and robust way of combining such homogeneous structure into more complex heterogeneous structure, and we show-case this for the combination of modular-width, tree-depth, and a natural notion of modular tree-depth. We give a generic framework for designing efficient parameterized algorithms on the created graph classes, aimed at getting competitive running times that match the homogeneous cases. To show the applicability we give efficient parameterized algorithms for Negative Cycle Detection, Vertex-Weighted All-Pairs Shortest Paths, and Triangle Counting.


title: Minimax Optimal Kernel Operator Learning via Multilevel Training

abstract: Learning mappings between infinite-dimensional function spaces has achieved empirical success in many disciplines of machine learning, including generative modeling, functional data analysis, causal inference, and multi-agent reinforcement learning. In this paper, we study the statistical limit of learning a Hilbert-Schmidt operator between two infinite-dimensional Sobolev reproducing kernel Hilbert spaces. We establish the information-theoretic lower bound in terms of the Sobolev Hilbert-Schmidt norm and show that a regularization that learns the spectral components below the bias contour and ignores the ones that are above the variance contour can achieve the optimal learning rate. At the same time, the spectral components between the bias and variance contours give us flexibility in designing computationally feasible machine learning algorithms. Based on this observation, we develop a multilevel kernel operator learning algorithm that is optimal when learning linear operators between infinite-dimensional function spaces.

categories: cs.LG cs.NA econ.EM math.NA math.ST stat.ML stat.TH


title: Increasing the Accuracy of a Neural Network Using Frequency Selective Mesh-to-Grid Resampling

abstract: Neural networks are widely used for almost any task of recognizing image content. Even though much effort has been put into investigating efficient network architectures, optimizers, and training strategies, the influence of image interpolation on the performance of neural networks is not well studied. Furthermore, research has shown that neural networks are often sensitive to minor changes in the input image leading to drastic drops of their performance. Therefore, we propose the use of keypoint agnostic frequency selective mesh-to-grid resampling (FSMR) for the processing of input data for neural networks in this paper. This model-based interpolation method already showed that it is capable of outperforming common interpolation methods in terms of PSNR. Using an extensive experimental evaluation we show that depending on the network architecture and classification task the application of FSMR during training aids the learning process. Furthermore, we show that the usage of FSMR in the application phase is beneficial. The classification accuracy can be increased by up to 4.31 percentage points for ResNet50 and the Oxflower17 dataset.


title: Martingale Transports and Monge Maps

abstract: It is well known that martingale transport plans between marginals $\mu\neq\nu$ are never given by Monge maps -- with the understanding that the map is over the first marginal $\mu$, or forward in time. Here, we change the perspective, with surprising results. We show that any distributions $\mu,\nu$ in convex order with $\nu$ atomless admit a martingale coupling given by a Monge map over the second marginal $\nu$. Namely, we construct a particular coupling called the barcode transport. Much more generally, we prove that such ``backward Monge'' martingale transports are dense in the set of all martingale couplings, paralleling the classical denseness result for Monge transports in the Kantorovich formulation of optimal transport. Various properties and applications are presented, including a refined version of Strassen's theorem and a mimicking theorem where the marginals of a given martingale are reproduced by a ``backward deterministic'' martingale, a remarkable type of process whose current state encodes its whole history.


title: Conversion between metavalent and covalent bond in metastable superlattices composed of 2D and 3D sublayers

abstract: Reversible conversion over multi-million-times in bond types between metavalent and covalent bonds becomes one of the most promising bases for universal memory. As the conversions have been found in metastable states, extended category of crystal structures from stable states via redistribution of vacancies, researches on kinetic behavior of the vacancies are highly on demand. However, they remain lacking due to difficulties with experimental analysis. Herein, the direct observation of the evolution of chemical states of vacancies clarifies the behavior by combining analysis on charge density distribution, electrical conductivity, and crystal structures. Site-switching of vacancies gradually occurs with diverged energy barriers owing to a unique activation code-the accumulation of vacancies triggers spontaneous gliding along atomic planes to relieve electrostatic repulsion. Study on the behavior can be further applied to multi-phase superlattices composed of Sb2Te3 (2D) and GeTe (3D) sublayers, which represent the superior memory performances but their operating mechanisms were still under debates due to their complexity. The site-switching is favorable (suppressed) when Te-Te bonds are formed as physisorption (chemisorption) over the interface between Sb2Te3 (2D) and GeTe (3D) sublayers driven by configurational entropic gain (electrostatic enthalpic loss). Depending on the type of interfaces between sublayers, phases of the superlattices are classified into metastable and stable states, where the conversion could be only achieved in the metastable state. From this comprehensive understanding on the operating mechanism via kinetic behaviors of vacancies and the metastability, further studies towards vacancy engineering are expected in versatile materials.


title: Efficient Medical Image Assessment via Self-supervised Learning

abstract: High-performance deep learning methods typically rely on large annotated training datasets, which are difficult to obtain in many clinical applications due to the high cost of medical image labeling. Existing data assessment methods commonly require knowing the labels in advance, which are not feasible to achieve our goal of 'knowing which data to label.' To this end, we formulate and propose a novel and efficient data assessment strategy, EXponentiAl Marginal sINgular valuE (EXAMINE) score, to rank the quality of unlabeled medical image data based on their useful latent representations extracted via Self-supervised Learning (SSL) networks. Motivated by theoretical implication of SSL embedding space, we leverage a Masked Autoencoder for feature extraction. Furthermore, we evaluate data quality based on the marginal change of the largest singular value after excluding the data point in the dataset. We conduct extensive experiments on a pathology dataset. Our results indicate the effectiveness and efficiency of our proposed methods for selecting the most valuable data to label.


title: Out-of-Distribution Detection for LiDAR-based 3D Object Detection

abstract: 3D object detection is an essential part of automated driving, and deep neural networks (DNNs) have achieved state-of-the-art performance for this task. However, deep models are notorious for assigning high confidence scores to out-of-distribution (OOD) inputs, that is, inputs that are not drawn from the training distribution. Detecting OOD inputs is challenging and essential for the safe deployment of models. OOD detection has been studied extensively for the classification task, but it has not received enough attention for the object detection task, specifically LiDAR-based 3D object detection. In this paper, we focus on the detection of OOD inputs for LiDAR-based 3D object detection. We formulate what OOD inputs mean for object detection and propose to adapt several OOD detection methods for object detection. We accomplish this by our proposed feature extraction method. To evaluate OOD detection methods, we develop a simple but effective technique of generating OOD objects for a given object detection model. Our evaluation based on the KITTI dataset shows that different OOD detection methods have biases toward detecting specific OOD objects. It emphasizes the importance of combined OOD detection methods and more research in this direction.


title: Precision Landing of a UAV on a Moving Platform for Outdoor Applications

abstract: As UAV technology improves, more uses have been found for these versatile autonomous vehicles, from surveillance to aerial photography, to package delivery, and each of these applications poses unique challenges. This paper implements a solution for one such challenge: To land on a moving target. This problem has been addressed before with varying degrees of success, however, most implementations focus on indoor applications. Outdoor poses greater challenges in the form of variables such as wind and lighting, and outdoor drones are heavier and more susceptible to inertial effects. Our approach is purely vision based, using a monocular camera and fiducial markers to localize the drone and a PID control to follow and land on the platform.


title: Slippery paraelectric transition metal dichalcogenide bilayers

abstract: Traditional ferroelectrics undergo thermally-induced phase transitions whereby their structural symmetry increases. The associated higher-symmetry structure is dubbed {\em paraelectric}. Ferroelectric transition metal dichalcogenide bilayers have been recently shown to become paraelectric, but not much has been said of the atomistic configuration of such a phase. As discovered through numerical calculations that include molecular dynamics here, their paraelectricity can only be ascribed to a time average of ferroelectric phases with opposing intrinsic polarizations, whose switching requires macroscopically large areas to slip in unison.


title: Kontsevich's star-product up to order 7 for affine Poisson brackets: where are the Riemann zeta values?

abstract: The Kontsevich star-product admits a well-defined restriction to the class of affine -- in particular, linear -- Poisson brackets; its graph expansion consists only of Kontsevich's graphs with in-degree $\leqslant 1$ for aerial vertices. We obtain the formula $\star_{\text{aff}}\text{ mod }\bar{o}(\hbar^7)$ with harmonic propagators for the graph weights; we verify that all these weights satisfy the cyclic weight relations by Shoikhet-Felder-Willwacher, that they match the computations using the $\textsf{kontsevint}$ software by Panzer, and that the resulting affine star-product is associative modulo $\bar{o}(\hbar^7)$. We discover that the Riemann zeta value $\zeta(3)^2/\pi^6$, which enters the harmonic graph weights (up to rationals), actually disappears from the analytic formula of $\star_{\text{aff}}\text{ mod }\bar{o}(\hbar^7)$ $\textit{because}$ all the $\mathbb{Q}$-linear combinations of Kontsevich graphs near $\zeta(3)^2/\pi^6$ represent differential consequences of the Jacobi identity for the affine Poisson bracket, hence their contribution vanishes. Exploring the work of Kontsevich's Formality theorem, for both the full star-product (for generic Poisson structures) and the affine star-product (as well as its reduced version), we discover that the mechanism of associativity for the star-product up to $\bar{o}(\hbar^6)$ is different from the mechanism at order $7$. Namely, at lower orders the needed consequences of the Jacobi identity are immediately obtained from the associator mod $\bar{o}(\hbar^6)$, whereas at order $\hbar^7$ and higher, some of the necessary differential consequences are reached from the Kontsevich graphs in the associator in strictly more than one step.


title: Breaking Time Invariance: Assorted-Time Normalization for RNNs

abstract: Methods such as Layer Normalization (LN) and Batch Normalization (BN) have proven to be effective in improving the training of Recurrent Neural Networks (RNNs). However, existing methods normalize using only the instantaneous information at one particular time step, and the result of the normalization is a preactivation state with a time-independent distribution. This implementation fails to account for certain temporal differences inherent in the inputs and the architecture of RNNs. Since these networks share weights across time steps, it may also be desirable to account for the connections between time steps in the normalization scheme. In this paper, we propose a normalization method called Assorted-Time Normalization (ATN), which preserves information from multiple consecutive time steps and normalizes using them. This setup allows us to introduce longer time dependencies into the traditional normalization methods without introducing any new trainable parameters. We present theoretical derivations for the gradient propagation and prove the weight scaling invariance property. Our experiments applying ATN to LN demonstrate consistent improvement on various tasks, such as Adding, Copying, and Denoise Problems and Language Modeling Problems.


title: GeONet: a neural operator for learning the Wasserstein geodesic

abstract: Optimal transport (OT) offers a versatile framework to compare complex data distributions in a geometrically meaningful way. Traditional methods for computing the Wasserstein distance and geodesic between probability measures require mesh-specific domain discretization and suffer from the curse-of-dimensionality. We present GeONet, a mesh-invariant deep neural operator network that learns the non-linear mapping from the input pair of initial and terminal distributions to the Wasserstein geodesic connecting the two endpoint distributions. In the offline training stage, GeONet learns the saddle point optimality conditions for the dynamic formulation of the OT problem in the primal and dual spaces that are characterized by a coupled PDE system. The subsequent inference stage is instantaneous and can be deployed for real-time predictions in the online learning setting. We demonstrate that GeONet achieves comparable testing accuracy to the standard OT solvers on simulation examples and the MNIST dataset with considerably reduced inference-stage computational cost by orders of magnitude.


title: Teaching physics in real-life contexts: The Beirut explosion

abstract: Teaching physics in real-life contexts continues to be a challenge for teachers at different educational levels. In this article, three Context-Rich Problems are proposed to be implemented in the classroom for higher education, using the explosion that occurred in Beirut as a case study. These problems require the search and analysis of real data, integrating technologies as tools to learn physics. In particular, the analysis of images, videos, maps and audio recordings is suggested. The proposed activities are designed to promote active learning of classical mechanics subjects and the development of collaborative skills. The results of each problem allow a discussion based on scientific evidence in the classroom.


title: Diffusiophoresis in the presence of a pH gradient

abstract: Diffusiophoresis is the spontaneous motion of particles under gradients of solutes. In electrolyte-driven diffusiophoresis, the zeta potential of the particles is an important surface property that characterizes diffusiophoretic mobility. However, the zeta potential is not a fixed material property and colloidal surfaces often show varying potentials depending on the physical chemistry of the surrounding fluid, e.g., solute type, ionic strength, and pH. In this article, we study experimentally and theoretically pH-dependent diffusiophoresis of polystyrene particles using a dead-end pore geometry. In particular, the influence of the isoelectric point (pI) on diffusiophoresis is demonstrated in the absence and presence of wall diffusioosmosis. Throughout the paper, we show with experiments and model calculations how the pH-dependent diffusiophoresis and diffusioosmosis influence the particle motion in dead-end pore configurations, including changes that occur when there is a sign change in the zeta potential near the pI.


title: Government Spending and Money Supply Roles in Alleviating Poverty in Africa

abstract: This study examines the roles of government spending and money supply on alleviating poverty in Africa. The study used 48 Sub-Saharan Africa countries from 2001 to 2017. The study employed one step and two-step system GMM and found that both the procedures have similar results. Different specifications were employed and the model selected was robust, with valid instruments and absence of autocorrelation at the second order. The study revealed that government spending and foreign direct investment have significant negative influence on reducing poverty while money supply has positive influence on the level of poverty in the region. The implication of the finding is that monetary policy tool of money supply has no strong influence in combating the menace of poverty. The study therefore recommends that emphasis should be placed on increasing more of government spending that would impact on the quality of life of the people in the region through multiplier effect, improving the financial system for effective monetary policy and attracting foreign direct inflows through enabling business environment in Africa.


title: Hierarchical Integration of Model Predictive and Fuzzy Logic Control for Combined Coverage and Target-Oriented Search-and-Rescue via Robots with Imperfect Sensors

abstract: Search-and-rescue (SaR) in unknown environments requires precise, optimal, and fast decisions. Robots are promising candidates for autonomously performing SaR tasks in unknown environments. While humans use their heuristics to effectively deal with uncertainties, optimisation of multiple objectives in the presence of physical and control constraints is a mathematical challenge that requires machine computations. Thus having both human-inspired and mathematical control capabilities is desired for SaR robots. Moreover, coordinating the decisions of robots with little computation cost in large-scale SaR missions is an open challenge. Finally, in real-life data perceived by SaR robots may be prone to uncertainties. We introduce a hierarchical multi-agent control architecture that exploits non-homogeneous and imperfect perception capabilities of SaR robots, as well as the computational efficiency and robustness to failure of decentralised control methods and global performance improvement of centralised control methods. The integrated structure of the proposed control framework allows to combine human-inspired and mathematical decision making methods in a coordinated and computationally efficient way. The results of various computer-based simulations show that while the area coverage of the proposed approach is comparable to existing heuristic methods that are particularly developed for coverage-oriented SaR, the efficiency of the introduced approach in locating the trapped victims is significantly higher. Furthermore, with comparable computation times, the proposed control approach successfully avoids potential conflicts that exist in non-cooperative methods. These results confirm that the proposed multi-agent control system is capable of combining coverage-oriented and target-oriented SaR in a balanced and coordinated way.


title: Electrical manipulation of valley-qubit and valley geometric phase in lateral monolayer heterostructures

abstract: We explore a solid state qubit defined on valley isospin of an electron confined in a gate-defined quantum dot created in an area of monolayer MoS$_2$/WS$_2$ lateral junction, where a steep dipolar potential emerges. We show that the junction oriented along an armchair direction can induce intervalley transitions of the electron confined in the neighboring quantum dot when the (gate-controllable) overlapping with the junction is significant and pumping frequency tuned. The pumping scheme that induces transitions is all-electrical: obtained by applying oscillating voltages to control gates and thus enables for scalable qubit architectures. We also report another possibility of valley-qubit manipulation by accumulating non-Abelian valley Berry phase. To model nanodevice we solve the time-dependent Schr\"odinger-Poisson equations in a tight-binding approach and obtain exact time-evolution of the valley-qubit system.


title: Temperature-dependent spin-lattice relaxation of the nitrogen-vacancy spin triplet in diamond

abstract: Spin-lattice relaxation within the nitrogen-vacancy (NV) center's electronic ground-state spin triplet limits its coherence times, and thereby impacts its performance in quantum applications. We report measurements of the relaxation rates on the NV center's $|m_{s}=0\rangle \leftrightarrow |m_{s}=\pm 1\rangle$ and $|m_{s}=-1\rangle \leftrightarrow |m_{s}=+1\rangle$ transitions as a function of temperature from 9 to 474 K in high-purity samples. We show that the temperature dependencies of the rates are reproduced by an ab initio theory of Raman scattering due to second-order spin-phonon interactions, and we discuss the applicability of the theory to other spin systems. Using a novel analytical model based on these results, we suggest that the high-temperature behavior of NV spin-lattice relaxation is dominated by interactions with two groups of quasilocalized phonons centered at 68.2(17) and 167(12) meV.


title: Visual Detection of Diver Attentiveness for Underwater Human-Robot Interaction

abstract: Many underwater tasks, such as cable-and-wreckage inspection, search-and-rescue, benefit from robust human-robot interaction (HRI) capabilities. With the recent advancements in vision-based underwater HRI methods, autonomous underwater vehicles (AUVs) can communicate with their human partners even during a mission. However, these interactions usually require active participation especially from humans (e.g., one must keep looking at the robot during an interaction). Therefore, an AUV must know when to start interacting with a human partner, i.e., if the human is paying attention to the AUV or not. In this paper, we present a diver attention estimation framework for AUVs to autonomously detect the attentiveness of a diver and then navigate and reorient itself, if required, with respect to the diver to initiate an interaction. The core element of the framework is a deep neural network (called DATT-Net) which exploits the geometric relation among 10 facial keypoints of the divers to determine their head orientation. Our on-the-bench experimental evaluations (using unseen data) demonstrate that the proposed DATT-Net architecture can determine the attentiveness of human divers with promising accuracy. Our real-world experiments also confirm the efficacy of DATT-Net which enables real-time inference and allows the AUV to position itself for an AUV-diver interaction.


title: Synthesizing Annotated Image and Video Data Using a Rendering-Based Pipeline for Improved License Plate Recognition

abstract: An insufficient number of training samples is a common problem in neural network applications. While data augmentation methods require at least a minimum number of samples, we propose a novel, rendering-based pipeline for synthesizing annotated data sets. Our method does not modify existing samples but synthesizes entirely new samples. The proposed rendering-based pipeline is capable of generating and annotating synthetic and partly-real image and video data in a fully automatic procedure. Moreover, the pipeline can aid the acquisition of real data. The proposed pipeline is based on a rendering process. This process generates synthetic data. Partly-real data bring the synthetic sequences closer to reality by incorporating real cameras during the acquisition process. The benefits of the proposed data generation pipeline, especially for machine learning scenarios with limited available training data, are demonstrated by an extensive experimental validation in the context of automatic license plate recognition. The experiments demonstrate a significant reduction of the character error rate and miss rate from 73.74% and 100% to 14.11% and 41.27% respectively, compared to an OCR algorithm trained on a real data set solely. These improvements are achieved by training the algorithm on synthesized data solely. When additionally incorporating real data, the error rates can be decreased further. Thereby, the character error rate and miss rate can be reduced to 11.90% and 39.88% respectively. All data used during the experiments as well as the proposed rendering-based pipeline for the automated data generation is made publicly available under (URL will be revealed upon publication).


title: Parameterized Quantum Circuits with Quantum Kernels for Machine Learning: A Hybrid Quantum-Classical Approach

abstract: Quantum machine learning (QML) is the use of quantum computing for the computation of machine learning algorithms. With the prevalence and importance of classical data, a hybrid quantum-classical approach to QML is called for. Parameterized Quantum Circuits (PQCs), and particularly Quantum Kernel PQCs, are generally used in the hybrid approach to QML. In this paper we discuss some important aspects of PQCs with quantum kernels including PQCs, quantum kernels, quantum kernels with quantum advantage, and the trainability of quantum kernels. We conclude that quantum kernels with hybrid kernel methods, a.k.a. quantum kernel methods, offer distinct advantages as a hybrid approach to QML. Not only do they apply to Noisy Intermediate-Scale Quantum (NISQ) devices, but they also can be used to solve all types of machine learning problems including regression, classification, clustering, and dimension reduction. Furthermore, beyond quantum utility, quantum advantage can be attained if the quantum kernels, i.e., the quantum feature encodings, are classically intractable.


title: Mathematical Models of Theory of Mind

abstract: Socially assistive robots provide physical and mental assistance for humans via cognitive human-machine interactions. These robots should sustain long-term engaging interactions with humans in a similar way humans interact with each other. According to the theory of mind, in their interactions humans develop cognitive models of each other in order to estimate their unobservable state-of-mind, predict their behavior, and act accordingly. Based on the theory of mind, we propose mathematical cognitive models of humans, which enable machines to understand cognitive procedures of humans in general and as distinct individuals. In particular, a network representation that is formulated based on a proposed extended version of fuzzy cognitive maps is introduced. The resulting models are identified and validated using (1) computer-based simulations designed according to a general data set of human's intuitive reasoning and literature and (2) real-life personalised experiments with 15 human participants. The results of the experiments show that the proposed cognitive models can excellently be personalised to different participants and precisely estimate and predict their current and future state-of-mind and expected behaviors.


title: Analytical Solution for Space-Charge Waves in a Two-Stream Cylindrical Electron Beam

abstract: We present an analytical method to compute the wavenumbers and electric fields of the space-charge-wave eigenmodes supported by a two-stream electron beam, consisting of a solid inner cylindrical stream and a coaxial outer annular stream, both contained within a cylindrical metallic tunnel.We extend the analytical model developed by Ramo to the case of two streams. The method accounts for the interaction between the two streams with the presence of the beam-tunnel wall; it can be used to model the complex wavenumbers associated with the two-stream instability and the plasma frequency reduction effects in vacuum electronic amplifiers and other vacuum electronic devices.


title: Enhanced electrocaloric and energy-storage properties of environment-friendly ferroelectric Ba0.9Sr0.1Ti1-xSnxO3 ceramics

abstract: The electrocaloric (EC) effect and energy storage properties of eco-friendly ferroelectric Ba0.9Sr0.1Ti1-xSnxO3 (BSTS-x) ceramics prepared by the conventional solid-state reaction method were studied. Significant energy efficiency exceeding 80% was found in our samples. In particular, BSTS-5 and BSTS-10 samples exhibit 92% and 88% efficiency, respectively, over a wide temperature range around room temperature (RT). Direct EC measurement and an indirect method based on the thermodynamic approach were used to characterize the EC effect, and both yielded consistent results. The largest electrocaloric responsivity of 0.73 K mm/kV was obtained for BSTS-0 at 368 K with an adiabatic temperature change DT(EC) of 0.55 K at a low applied electric field of only 7.4 kV/cm. With increasing Sn-content, the EC response of BSTS-x ceramics decreases, while their diffuseness increases over an extensive temperature range, centered at RT. A significant coefficient of performance (COP > 26) was found for our samples. The obtained results demonstrate the possibility of designing eco-friendly materials with higher EC effect and energy efficiency for potential solid-state refrigeration and energy storage devices.


title: Multi-mode Gaussian State Analysis with Total Photon Counting

abstract: The continuing improvement in the qualities of photon-number-resolving detectors opens new possibilities for measuring quantum states of light. In this work we consider the question of what properties of an arbitrary multimode Gaussian state are determined by a single photon-number-resolving detector that measures total photon number. We find an answer to this question in the ideal case where the exact photon-number probabilities are known. We show that the quantities determined by the total photon number distribution are the spectrum of the covariance matrix, the absolute displacement in each eigenspace of the covariance matrix, and nothing else. In the case of pure Gaussian states, the spectrum determines the squeezing parameters.


title: CompNet: A Designated Model to Handle Combinations of Images and Designed features

abstract: Convolutional neural networks (CNNs) are one of the most popular models of Artificial Neural Networks (ANN)s in Computer Vision (CV). A variety of CNN-based structures were developed by researchers to solve problems like image classification, object detection, and image similarity measurement. Although CNNs have shown their value in most cases, they still have a downside: they easily overfit when there are not enough samples in the dataset. Most medical image datasets are examples of such a dataset. Additionally, many datasets also contain both designed features and images, but CNNs can only deal with images directly. This represents a missed opportunity to leverage additional information. For this reason, we propose a new structure of CNN-based model: CompNet, a composite convolutional neural network. This is a specially designed neural network that accepts combinations of images and designed features as input in order to leverage all available information. The novelty of this structure is that it uses learned features from images to weight designed features in order to gain all information from both images and designed features. With the use of this structure on classification tasks, the results indicate that our approach has the capability to significantly reduce overfitting. Furthermore, we also found several similar approaches proposed by other researchers that can combine images and designed features. To make comparison, we first applied those similar approaches on LIDC and compared the results with the CompNet results, then we applied our CompNet on the datasets that those similar approaches originally used in their works and compared the results with the results they proposed in their papers. All these comparison results showed that our model outperformed those similar approaches on classification tasks either on LIDC dataset or on their proposed datasets.


title: Using the Sinkhorn divergence in permutation tests for the multivariate two-sample problem

abstract: In order to adapt the Wasserstein distance to the large sample multivariate non-parametric two-sample problem, making its application computationally feasible, permutation tests based on the Sinkhorn divergence between probability vectors associated to data dependent partitions are considered. Different ways of implementing these tests are evaluated and the asymptotic distribution of the underlying statistic is established in some cases. The statistics proposed are compared, in simulated examples, with the test of Schilling's, one of the best non-parametric tests available in the literature.


title: Machine Learning for Optical Motion Capture-driven Musculoskeletal Modelling from Inertial Motion Capture Data

abstract: Marker-based Optical Motion Capture (OMC) systems and associated musculoskeletal (MSK) modelling predictions offer non-invasively obtainable insights into in vivo joint and muscle loading, aiding clinical decision-making. However, an OMC system is lab-based, expensive, and requires a line of sight. Inertial Motion Capture (IMC) systems are widely-used alternatives, which are portable, user-friendly, and relatively low-cost, although with lesser accuracy. Irrespective of the choice of motion capture technique, one needs to use an MSK model to obtain the kinematic and kinetic outputs, which is a computationally expensive tool increasingly well approximated by machine learning (ML) methods. Here, we present an ML approach to map experimentally recorded IMC data to the human upper-extremity MSK model outputs computed from ('gold standard') OMC input data. Essentially, we aim to predict higher-quality MSK outputs from the much easier-to-obtain IMC data. We use OMC and IMC data simultaneously collected for the same subjects to train different ML architectures that predict OMC-driven MSK outputs from IMC measurements. In particular, we employed various neural network (NN) architectures, such as Feed-Forward Neural Networks (FFNNs) and Recurrent Neural Networks (RNNs) (vanilla, Long Short-Term Memory, and Gated Recurrent Unit) and searched for the best-fit model through an exhaustive search in the hyperparameters space in both subject-exposed (SE) & subject-naive (SN) settings. We observed a comparable performance for both FFNN & RNN models, which have a high degree of agreement (ravg, SE, FFNN = 0.90+/-0.19, ravg, SE, RNN = 0.89+/-0.17, ravg, SN, FFNN = 0.84+/-0.23, & ravg, SN, RNN = 0.78+/-0.23) with the desired OMC-driven MSK estimates for held-out test data. Mapping IMC inputs to OMC-driven MSK outputs using ML models could be instrumental in transitioning MSK modelling from 'lab to field'.


title: Consensus-Free Spreadsheet Integration

abstract: We describe a method for merging multiple spreadsheets into one sheet, and/or exchanging data among the sheets, by expressing each sheet's formulae as an algebraic (equational) theory and each sheet's values as a model of its theory, expressing the overlap between the sheets as theory and model morphisms, and then performing colimit, lifting, and Kan-extension constructions from category theory to compute a canonically universal integrated theory and model, which can then be expressed as a spreadsheet. Our motivation is to find methods of merging engineering models that do not require consensus (agreement) among the authors of the models being merged, a condition fulfilled by our method because theory and model morphisms are semantics-preserving. We describe a case study of this methodology on a real-world oil and gas calculation at a major energy company, describing the theories and models that arise when integrating two different casing pressure test (MASP) calculation spreadsheets constructed by two non-interacting engineers. We also describe the automated theorem proving burden associated with both verifying the semantics preservation of the overlap mappings as well as verifying the conservativity/consistency of the resulting integrated sheet. We conclude with thoughts on how to apply the methodology to scale engineering efforts across the enterprise.


title: The Chamber Ensemble Generator: Limitless High-Quality MIR Data via Generative Modeling

abstract: Data is the lifeblood of modern machine learning systems, including for those in Music Information Retrieval (MIR). However, MIR has long been mired by small datasets and unreliable labels. In this work, we propose to break this bottleneck using generative modeling. By pipelining a generative model of notes (Coconet trained on Bach Chorales) with a structured synthesis model of chamber ensembles (MIDI-DDSP trained on URMP), we demonstrate a system capable of producing unlimited amounts of realistic chorale music with rich annotations including mixes, stems, MIDI, note-level performance attributes (staccato, vibrato, etc.), and even fine-grained synthesis parameters (pitch, amplitude, etc.). We call this system the Chamber Ensemble Generator (CEG), and use it to generate a large dataset of chorales from four different chamber ensembles (CocoChorales). We demonstrate that data generated using our approach improves state-of-the-art models for music transcription and source separation, and we release both the system and the dataset as an open-source foundation for future work in the MIR community.


title: Spin triangle chain with ferromagnetic and antiferromagnetic interactions on the transition line

abstract: We investigate spin-$\frac{1}{2}$ anisotropic model of a linear chain of triangles with competing ferro- and antiferromagnetic interactions and ferromagneic Heisenberg interactions between triangles. For a certain ratio between interactions the one-magnon excitation band is dispersionless leading to an existence of localized-magnon states which form macroscopically degenerated ground states. The spectrum of excitations has a specific structure depending on the value of the triangle-triangle interaction. Such specific structure determines the low-temperature thermodynamics and, in particular, the temperature dependence of a specific heat. In the limit of strong anisotropy of interactions the spectrum has a multi-scale structure which consists of subsets rank-ordered on small parameter. Each subset is responsible for the appearance of the peak in the temperature dependence of the specific heat.


title: A Scalable Approach to Large Scale Risk-Averse Distribution Grid Expansion Planning

abstract: Distribution grid reliability and resilience has become a major topic of concern for utilities and their regulators. In particular, with the increase in severity of extreme events, utilities are considering major investments in distribution grid assets to mitigate the damage of highly impactful outages. Communicating the overall economic and risk-mitigation benefits of these investments to regulators is an important element of the approval process. Today, industry reliability and resilience planning practices are based largely on methods that do not take explicit account of risk. This paper proposes a practical method for identifying optimal combinations of investments in new line segments and storage devices while considering the balance between the risk associated with high impact low probability events and the reliability related to routine failures. We show that this method can be scaled to address large scale networks and demonstrate its benefits using a Target Feeder from the Commonwealth Edison Reliability Program.


title: Constrained Dynamic Movement Primitives for Safe Learning of Motor Skills

abstract: Dynamic movement primitives are widely used for learning skills which can be demonstrated to a robot by a skilled human or controller. While their generalization capabilities and simple formulation make them very appealing to use, they possess no strong guarantees to satisfy operational safety constraints for a task. In this paper, we present constrained dynamic movement primitives (CDMP) which can allow for constraint satisfaction in the robot workspace. We present a formulation of a non-linear optimization to perturb the DMP forcing weights regressed by locally-weighted regression to admit a Zeroing Barrier Function (ZBF), which certifies workspace constraint satisfaction. We demonstrate the proposed CDMP under different constraints on the end-effector movement such as obstacle avoidance and workspace constraints on a physical robot. A video showing the implementation of the proposed algorithm using different manipulators in different environments could be found here https://youtu.be/hJegJJkJfys.


title: What Can Cryptography Do For Decentralized Mechanism Design

abstract: Recent works of Roughgarden (EC'21) and Chung and Shi (SODA'23) initiate the study of a new decentralized mechanism design problem called transaction fee mechanism design (TFM). Unlike the classical mechanism design literature, in the decentralized environment, even the auctioneer (i.e., the miner) can be a strategic player, and it can even collude with a subset of the users facilitated by binding side contracts. Chung and Shi showed two main impossibility results that rule out the existence of a {\it dream} TFM. First, any TFM that provides incentive compatibility for individual users and miner-user coalitions must always have zero miner revenue, no matter whether the block size is finite or infinite. Second, assuming finite block size, no non-trivial TFM can simultaenously provide incentive compatibility for any individual user, and for any miner-user coalition. In this work, we explore what new models and meaningful relaxations can allow us to circumvent the impossibility results of Chung and Shi. Besides today's model that does not employ cryptography, we introduce a new MPC-assisted model where the TFM is implemented by a joint multi-party computation (MPC) protocol among the miners. We prove several feasibility and infeasibility results for achieving {\it strict} and {\it approximate} incentive compatibility, respectively, in the plain model as well as the MPC-assisted model. We show that while cryptography is not a panacea, it indeed allows us to overcome some impossibility results pertaining to the plain model, leading to non-trivial mechanisms with useful guarantees that are otherwise impossible in the plain model. Our work is also the first to characterize the mathematical landscape of transaction fee mechanism design under approximate incentive compatibility, as well as in a cryptography-assisted model.


title: Stress focusing and damage protection in topological Maxwell metamaterials

abstract: Advances in the field of topological mechanics have highlighted a number of special mechanical properties of Maxwell lattices, including the ability to focus zero-energy floppy modes and states of self-stress (SSS) at their edges and interfaces. Due to their topological character, these phenomena are protected against perturbations in the lattice geometry and material properties, which makes them robust against the emergence of structural non-idealities, defects, and damage. Recent computational work has shown that the ability of Maxwell lattices to focus stress along prescribed SSS domain walls can be harnessed for the purpose of protecting other regions in the bulk of the lattice from detrimental stress concentration and, potentially, inhibiting the onset of fracture mechanisms at stress hot spots such as holes and cracks. This property provides a powerful, geometry-based tool for the design of lattice configurations that are robust against damage and fracture. In this work, we provide a comprehensive experiment-driven exploration of this idea in the context of realistic structural lattices characterized by non-ideal, finite-thickness hinges. Our experiments document the onset of pronounced domain wall stress focusing, indicating a remarkable robustness of the polarization even in the presence of the dilutive effects of the structural hinges. We also demonstrate that the polarization protects the lattice against potential failure from defected hinges and cracks in the bulk. Finally, we illustrate numerically the superiority of SSS domain walls compared to other trivial forms of reinforcements.


title: Neural Methods for Logical Reasoning Over Knowledge Graphs

abstract: Reasoning is a fundamental problem for computers and deeply studied in Artificial Intelligence. In this paper, we specifically focus on answering multi-hop logical queries on Knowledge Graphs (KGs). This is a complicated task because, in real-world scenarios, the graphs tend to be large and incomplete. Most previous works have been unable to create models that accept full First-Order Logical (FOL) queries, which include negative queries, and have only been able to process a limited set of query structures. Additionally, most methods present logic operators that can only perform the logical operation they are made for. We introduce a set of models that use Neural Networks to create one-point vector embeddings to answer the queries. The versatility of neural networks allows the framework to handle FOL queries with Conjunction ($\wedge$), Disjunction ($\vee$) and Negation ($\neg$) operators. We demonstrate experimentally the performance of our model through extensive experimentation on well-known benchmarking datasets. Besides having more versatile operators, the models achieve a 10\% relative increase over the best performing state of the art and more than 30\% over the original method based on single-point vector embeddings.


title: Practical Challenges in Landing a UAV on a Dynamic Target

abstract: Unmanned Aerial Vehicles grow more popular by the day and applications for them are crossing boundaries of science and industry, with everything from aerial photography to package delivery to disaster management benefiting from the technology. But before they become commonplace, there are challenges to be solved to make them reliable and safe. The following paper discusses the challenges associated with the precision landing of an Unmanned Aerial Vehicle, including methods for sensing and control and their merits and shortcomings for various applications.


title: Polar alignment of a massive retrograde circumbinary disc around an eccentric binary

abstract: A test particle orbit around an eccentric binary has two stationary states in which there is no nodal precession: coplanar and polar. Nodal precession of a misaligned test particle orbit centres on one of these stationary states. A low mass circumbinary disc undergoes the same precession and moves towards one of these states through dissipation within the disc. For a massive particle orbit, the stationary polar alignment occurs at an inclination less than $90^{\circ}$, this is the prograde-polar stationary inclination. A sufficiently high angular momentum particle has an additional higher inclination stationary state, the retrograde-polar stationary inclination. Misaligned particle orbits close to the retrograde-polar stationary inclination are not nested like the orbits close to the other stationary points. We investigate the evolution of a gas disc that begins close to the retrograde-polar stationary inclination. With hydrodynamical disc simulations, we find that the disc moves through the unnested crescent shape precession orbits and eventually moves towards the prograde-polar stationary inclination thus increasing the parameter space over which circumbinary discs move towards polar alignment. If protoplanetary discs form with an isotropic orientation relative to the binary orbit, then polar discs may be more common than coplanar discs around eccentric binaries, even for massive discs. This has implications for the alignment of circumbinary planets.


title: Reducing Positional Variance in Cross-sectional Abdominal CT Slices with Deep Conditional Generative Models

abstract: 2D low-dose single-slice abdominal computed tomography (CT) slice enables direct measurements of body composition, which are critical to quantitatively characterizing health relationships on aging. However, longitudinal analysis of body composition changes using 2D abdominal slices is challenging due to positional variance between longitudinal slices acquired in different years. To reduce the positional variance, we extend the conditional generative models to our C-SliceGen that takes an arbitrary axial slice in the abdominal region as the condition and generates a defined vertebral level slice by estimating the structural changes in the latent space. Experiments on 1170 subjects from an in-house dataset and 50 subjects from BTCV MICCAI Challenge 2015 show that our model can generate high quality images in terms of realism and similarity. External experiments on 20 subjects from the Baltimore Longitudinal Study of Aging (BLSA) dataset that contains longitudinal single abdominal slices validate that our method can harmonize the slice positional variance in terms of muscle and visceral fat area. Our approach provides a promising direction of mapping slices from different vertebral levels to a target slice to reduce positional variance for single slice longitudinal analysis. The source code is available at: https://github.com/MASILab/C-SliceGen.


title: Auditing for Core Stability in Participatory Budgeting

abstract: We consider the participatory budgeting problem where each of $n$ voters specifies additive utilities over $m$ candidate projects with given sizes, and the goal is to choose a subset of projects (i.e., a committee) with total size at most $k$. Participatory budgeting mathematically generalizes multiwinner elections, and both have received great attention in computational social choice recently. A well-studied notion of group fairness in this setting is core stability: Each voter is assigned an "entitlement" of $\frac{k}{n}$, so that a subset $S$ of voters can pay for a committee of size at most $|S| \cdot \frac{k}{n}$. A given committee is in the core if no subset of voters can pay for another committee that provides each of them strictly larger utility. This provides proportional representation to all voters in a strong sense. In this paper, we study the following auditing question: Given a committee computed by some preference aggregation method, how close is it to the core? Concretely, how much does the entitlement of each voter need to be scaled down by, so that the core property subsequently holds? As our main contribution, we present computational hardness results for this problem, as well as a logarithmic approximation algorithm via linear program rounding. We show that our analysis is tight against the linear programming bound. Additionally, we consider two related notions of group fairness that have similar audit properties. The first is Lindahl priceability, which audits the closeness of a committee to a market clearing solution. We show that this is related to the linear programming relaxation of auditing the core, leading to efficient exact and approximation algorithms for auditing. The second is a novel weakening of the core that we term the sub-core, and we present computational results for auditing this notion as well.


title: Weak-Coupling Theory of Pair Density-Wave Instabilities in Transition Metal Dichalcogenides

abstract: The possibility of realizing pair density wave (PDW) phases, in which Cooper pairs have a finite momentum, presents an interesting challenge that has been studied in a wide variety of systems. In conventional superconductors, this is only possible when external fields lift the spin degeneracy of the Fermi surface, leading to pair formation at an incommensurate momentum. Here, we study a second possibility, potentially relevant to transition metal dichalcogenides, in which the Fermi surface consists of a pair of pockets centered at the $\pm K$ points of the Brillouin zone as well as a central pocket at the $\Gamma$ point. In the limit where these three pockets are identical, the pairing susceptibility has a logarithmic divergence at the non-zero wave-vectors $\pm \mathbf{K}$, allowing for a weak-coupling analysis of the PDW instability. We find that repulsive electronic interactions combine to yield effective attractive interactions in the singlet and triplet PDW channels, as long as the $\Gamma$ pocket is present. Because these PDW channels decouple from the uniform superconducting channel, they can become the leading unconventional pairing instability of the system. Upon solving the linearized gap equations, we find that the PDW instability is robust against small trigonal warping of the $\pm K$ pockets and small detuning between the $\Gamma$ and $\pm K$ pockets, which affect the PDW transition in a similar way as the Zeeman magnetic field affects the uniform superconducting transition. We also derive the Ginzburg-Landau free energy for the PDW gaps with momenta $\pm \mathbf{K}$, analyzing the conditions for and consequences of the emergence of FF-type and LO-type PDW ground states. Our classification of the induced orders in each ground state reveals unusual phases, including an odd-frequency charge-$2e$ superconductor in the LO-type PDW.


title: The contravariant functoriality of graph algebras

abstract: The unions of directed graphs are the simplest examples of pushouts of directed graphs. The conditions under which they contravariantly induce surjective gauge-equivariant pullbacks of graph C*-algebras have been well studied and vastly instantiated in noncommutative topology (e.g., quantum balls and spheres). Herein, we go beyond the unions of graphs to systematically determine optimal conditions for more general pushouts of graphs under which they contravariantly induce graded pullbacks of path algebras, Leavitt path algebras, and graph C*-algebras. Our pullbacks are surjective only on one side, as dictated by natural examples and K-theory. The proposed new approach enlarges the scope of applications from admissible subgraphs (also called quotient graphs) to generalizations of unlabeled foldings of Stallings, collapsing the line graphs of graphs to initial graphs, and shrinking loops (or cycles).


title: Lazy Probabilistic Roadmaps Revisited

abstract: This paper describes a revision of the classic Lazy Probabilistic Roadmaps algorithm (Lazy PRM), that results from pairing PRM and a novel Branch-and-Cut (BC) algorithm. Cuts are dynamically generated constraints that are imposed on minimum cost paths over the geometric graphs selected by PRM. Cuts eliminate paths that cannot be mapped into smooth plans that satisfy suitably defined kinematic constraints. We generate candidate smooth plans by fitting splines to vertices in minimum-cost path. Plans are validated with a recently proposed algorithm that maps them into finite traces, without need to choose a fixed discretization step. Trace elements exactly describe when plans cross constraint boundaries modulo arithmetic precision. We evaluate several planners using our methods over the recently proposed BARN benchmark, and we report evidence of the scalability of our approach.


title: medigan: a Python library of pretrained generative models for medical image synthesis

abstract: Synthetic data generated by generative models can enhance the performance and capabilities of data-hungry deep learning models in medical imaging. However, there is (1) limited availability of (synthetic) datasets and (2) generative models are complex to train, which hinders their adoption in research and clinical applications. To reduce this entry barrier, we propose medigan, a one-stop shop for pretrained generative models implemented as an open-source framework-agnostic Python library. medigan allows researchers and developers to create, increase, and domain-adapt their training data in just a few lines of code. Guided by design decisions based on gathered end-user requirements, we implement medigan based on modular components for generative model (i) execution, (ii) visualisation, (iii) search & ranking, and (iv) contribution. The library's scalability and design is demonstrated by its growing number of integrated and readily-usable pretrained generative models consisting of 21 models utilising 9 different Generative Adversarial Network architectures trained on 11 datasets from 4 domains, namely, mammography, endoscopy, x-ray, and MRI. Furthermore, 3 applications of medigan are analysed in this work, which include (a) enabling community-wide sharing of restricted data, (b) investigating generative model evaluation metrics, and (c) improving clinical downstream tasks. In (b), extending on common medical image synthesis assessment and reporting standards, we show Fr\'echet Inception Distance variability based on image normalisation and radiology-specific feature extraction.


title: Testing SALT Approximations with Numerical Radiation Transfer Code Part 1: Validity and Applicability

abstract: Absorption line spectroscopy offers one of the best opportunities to constrain the properties of galactic outflows and the environment of the circumgalactic medium. Extracting physical information from line profiles is difficult, however, for the physics governing the underlying radiation transfer is complicated and depends on many different parameters. Idealized analytical models are necessary to constrain the large parameter spaces efficiently, but are typically plagued by model degeneracy and systematic errors. Comparison tests with idealized numerical radiation transfer codes offer an excellent opportunity to confront both of these issues. In this paper, we present a detailed comparison between SALT, an analytical radiation transfer model for predicting UV spectra of galactic outflows, with the numerical radiation transfer software, RASCAS. Our analysis has lead to upgrades to both models including an improved derivation of SALT and a customizable adaptive mesh refinement routine for RASCAS. We explore how well SALT, when paired with a Monte Carlo fitting procedure, can recover flow parameters from non-turbulent and turbulent flows. When the velocity and density gradients are excluded, we find that flow parameters are well recovered from high resolution (20 $\rm{km}$ $\rm{s}^{-1}$) data and moderately well from medium resolution (100 $\rm{km}$ $\rm{s}^{-1}$) data without turbulence at a S/N = 10, while derived quantities (e.g., mass outflow rates, column density, etc.) are well recovered at all resolutions. In the turbulent case, biased errors emerge in the recovery of individual parameters, but derived quantities are still well recovered.


title: A slight generalization of Steffensen Method for Solving Non Linear Equations

abstract: In this article, we present an iterative method to find simple roots of nonlinear equations, that is, to solving an equation of the form $f(x) = 0$. Different from Newton's method, the method we purpose do not require evaluation of derivatives. The method is based on the classical Steffensen's method and it is a slight modification of it. The proofs of theoretical results are stated using Landau's Little o notation and simples concepts of Real Analysis. We prove that the method converges and its rate of convergence is quadratic. The method present some advantages when compared with Newton's and Steffesen's methods as ilustrated by numerical tests given.


title: Intrinsic Dimensionality Estimation within Tight Localities: A Theoretical and Experimental Analysis

abstract: Accurate estimation of Intrinsic Dimensionality (ID) is of crucial importance in many data mining and machine learning tasks, including dimensionality reduction, outlier detection, similarity search and subspace clustering. However, since their convergence generally requires sample sizes (that is, neighborhood sizes) on the order of hundreds of points, existing ID estimation methods may have only limited usefulness for applications in which the data consists of many natural groups of small size. In this paper, we propose a local ID estimation strategy stable even for `tight' localities consisting of as few as 20 sample points. The estimator applies MLE techniques over all available pairwise distances among the members of the sample, based on a recent extreme-value-theoretic model of intrinsic dimensionality, the Local Intrinsic Dimension (LID). Our experimental results show that our proposed estimation technique can achieve notably smaller variance, while maintaining comparable levels of bias, at much smaller sample sizes than state-of-the-art estimators.


title: On the general position numbers of maximal outerplanar graphs

abstract: A subset $R\subseteq V(G)$ of a graph $G$ is a general position set if any triple set $R_0$ of $R$ is non-geodesic in $G$, that is, no vertex of $R_0$ lies on any geodesic between the other two vertices of $R_0$ in $G$. Let $\mathcal{R}$ be the set of general position sets of a graph $G$. The general position number of a graph $G$, denoted by $gp(G)$, is defined as $gp(G)=\max\{|R|:R\in\mathcal{R}\}$. In this paper, we determine the bounds on the gp-numbers for any maximal outerplane graph and characterize the corresponding extremal graphs.


title: Use of indicator functions to enumerate cross-array designs without direct product structure

abstract: Use of polynomial indicator functions to enumerate fractional factorial designs with given properties is first introduced by Fontana, Pistone and Rogantin (2000) for two-level factors, and generalized by Aoki (2019) for multi-level factors. In this paper, we apply this theory to enumerate cross-array designs. For the experiments of several control factors and noise factors, use of the cross-array designs with direct product structure is widespread as an effective robust strategy in Taguchi method. In this paper, we relax this direct product structure to reduce the size of the designs. We obtain 24-runs cross-array designs without direct product structure with some desirable properties for 6 control factors and 3 noise factors, each with two-levels, instead of 32-runs design that is widely used.


title: Grid entropy in last passage percolation -- a superadditive critical exponent approach

abstract: Working in the setting of i.i.d. last-passage percolation on $\mathbb{R}^D$ with no assumptions on the underlying edge\hyp{}weight distribution, we arrive at the notion of grid entropy - a Subadditive Ergodic Theorem limit of the entropies of paths with empirical measures weakly converging to a given target, or equivalently a deterministic critical exponent of canonical order statistics associated with the Levy-Prokhorov metric. This provides a fresh approach to an entropy first developed by Rassoul-Agha and Sepp\"al\"ainen as a large deviation rate function of empirical measures along paths. In their 2014 paper arXiv:1202.2584, variational formulas are developed for the point-to-point/point-to-level Gibbs Free Energies as the convex conjugates of this entropy. We rework these formulas in our new framework and explicitly link our descriptions of grid entropy to theirs. We also improve on a known bound for this entropy by introducing a relative entropy term in the inequality. Furthermore, we show that the set of measures with finite grid entropy coincides with the deterministic set of limit points of empirical measures studied in a recent paper arXiv:2006.12580 by Bates. In addition, we partially answer a directed polymer version of a question of Hoffman which was previously tackled in the zero temperature case by Bates. Our results cover both the point-to-point and point-to-level scenarios.


title: Semantics-Guided Object Removal for Facial Images: with Broad Applicability and Robust Style Preservation

abstract: Object removal and image inpainting in facial images is a task in which objects that occlude a facial image are specifically targeted, removed, and replaced by a properly reconstructed facial image. Two different approaches utilizing U-net and modulated generator respectively have been widely endorsed for this task for their unique advantages but notwithstanding each method's innate disadvantages. U-net, a conventional approach for conditional GANs, retains fine details of unmasked regions but the style of the reconstructed image is inconsistent with the rest of the original image and only works robustly when the size of the occluding object is small enough. In contrast, the modulated generative approach can deal with a larger occluded area in an image and provides {a} more consistent style, yet it usually misses out on most of the detailed features. This trade-off between these two models necessitates an invention of a model that can be applied to any size of mask while maintaining a consistent style and preserving minute details of facial features. Here, we propose Semantics-Guided Inpainting Network (SGIN) which itself is a modification of the modulated generator, aiming to take advantage of its advanced generative capability and preserve the high-fidelity details of the original image. By using the guidance of a semantic map, our model is capable of manipulating facial features which grants direction to the one-to-many problem for further practicability.


title: Du Bois property of log centers

abstract: In this note we generalize the results of [KK10] and [KK20] by showing that if a closed subset V of X is "close enough" to being a union of log canonical centers, then it is Du Bois.


title: Contour dynamics and global regularity for periodic vortex patches and layers

abstract: We study vortex patches for the 2D incompressible Euler equations. Prior works on this problem take the support of the vorticity (i.e., the vortex patch) to be a bounded region. We instead consider the horizontally periodic setting. This includes both the case of a periodic array of bounded vortex patches and the case of vertically bounded vortex layers. We develop the contour dynamics equation for the boundary of the patch in this horizontally periodic setting, and demonstrate global $C^{1,\epsilon}$ regularity of this patch boundary. In the process of formulating the problem, we consider different notions of periodic solutions of the 2D incompressible Euler equations, and demonstrate equivalence of these.


title: The Spectroscopic Data Processing Pipeline for the Dark Energy Spectroscopic Instrument

abstract: We describe the spectroscopic data processing pipeline of the Dark Energy Spectroscopic Instrument (DESI), which is conducting a redshift survey of about 40 million galaxies and quasars using a purpose-built instrument on the 4-m Mayall Telescope at Kitt Peak National Observatory. The main goal of DESI is to measure with unprecedented precision the expansion history of the Universe with the Baryon Acoustic Oscillation technique and the growth rate of structure with Redshift Space Distortions. Ten spectrographs with three cameras each disperse the light from 5000 fibers onto 30 CCDs, covering the near UV to near infrared (3600 to 9800 Angstrom) with a spectral resolution ranging from 2000 to 5000. The DESI data pipeline generates wavelength- and flux-calibrated spectra of all the targets, along with spectroscopic classifications and redshift measurements. Fully processed data from each night are typically available to the DESI collaboration the following morning. We give details about the pipeline's algorithms, and provide performance results on the stability of the optics, the quality of the sky background subtraction, and the precision and accuracy of the instrumental calibration. This pipeline has been used to process the DESI Survey Validation data set, and has exceeded the project's requirements for redshift performance, with high efficiency and a purity greater than 99 percent for all target classes.


title: Grid entropy in a "choose the best of D samples" model

abstract: Grid entropy is a deterministic quantity inherent to lattice models which captures the entropy of empirical measures along paths that converge weakly to a given target measure. In this paper, we study the limiting behaviour of empirical measures in a model consisting of repeatedly taking $D$ samples from a distribution and picking out one according to an omniscient "strategy." We show that the set of limit points of empirical measures is almost surely the same whether or not we restrict ourselves to strategies which make the choices independently of all past and future choices, and furthermore, that this set coincides with the set of measures with finite grid entropy. This set is convex and weakly compact; we characterize its extreme points as those given by a natural "greedy" deterministic strategy and we compute the grid entropy of said extreme points to be 0. This yields a description of the set of limit points of empirical measures as the closed convex hull of measures given by a density which is $D \cdot Beta(1,D)$ distributed. We also derive a simplified version of a grid entropy-based variational formula for Gibbs Free Energy for this model, and we present the dual formula for grid entropy.


title: Equation of state, and atomic electron effective potential, for a Weyl scaling invariant dark energy

abstract: A key attribute of dark energy is the equation of state parameter $w={\rm pressure}/{\rm energy~density}$, and this has been recently measured observationally, giving values close to $-1$. In this paper we calculate the $w$ parameter characterizing the novel Weyl scaling invariant dark energy that we have analyzed in a series of papers, and show that it is compatible with experiment. We also derive the atomic electron effective potential induced by dark energy from the electron geodesic equation, which can be applied to the evaluation of energy level shifts in Rydberg atoms.


title: A Semi-Analytical Line Transfer (SALT) Model III: Galactic Inflows

abstract: We present calculations of ultraviolet spectra resulting from the scattering of photons by gas in-falling onto an isotropically emitting source of radiation. The model is based on an adaptation of the semi-analytical line transfer (SALT) code of Scarlata & Panagia (2015), and designed to interpret the inverse P-Cygni profiles observed in the spectra of partially ionized galactic inflows. In addition to presenting the model, we explore the parameter space of the inflowing SALT model and recreate various physically motivated scenarios including spherical inflows, inflows with covering fractions less than unity, and galactic fountains (i.e., galactic systems with both an inflowing and outflowing component). The resulting spectra from inflowing gas show spectral features that could be misinterpreted as ISM features in low resolution spectroscopy ($\sigma \approx 120$ $\rm{km }$ $\rm{s}^{-1}$), suggesting that the total number of galactic systems with inflows is undercounted. Our models suggest that observations at medium resolution ($R = 6000$ or $\sigma \approx 50$ $\rm{km }$ $\rm{s}^{-1}$) that can be obtained with 8m-class telescopes will be able to resolve the characteristic inverse P Cygni profiles necessary to identify inflows.


title: Requirement analysis for dE/dx measurement and PID performance at the CEPC baseline detector

abstract: The Circular Electron-Positron Collider (CEPC) can be operated not only as a Higgs factory but also as a Z-boson factory, offering great opportunities for flavor physics studies where Particle Identification (PID) is critical. The baseline detector of the CEPC could record TOF and dE/dx information that can be used to distinguish particles of different species. We quantify the physics requirements and detector performance using physics benchmark analyzes with full simulation. We conclude that at the benchmark TOF performance of $50\,$ps, the dE/dx resolution should be better than 3% for incident particles in the barrel region with a relevant energy larger than $2\, $GeV/c. This performance leads to an efficiency/purity of $K^{\pm}$ identification 97%/96%, $D^0\to \pi^+K^-$ reconstruction 68.19%/89.05%, and $\phi\to K^+K^-$ reconstruction 82.26%/77.70%, providing solid support for relevant CEPC flavor physics measurements.


title: A High-Performance Design for Hierarchical Parallelism in the QMCPACK Monte Carlo code

abstract: We introduce a new high-performance design for parallelism within the Quantum Monte Carlo code QMCPACK. We demonstrate that the new design is better able to exploit the hierarchical parallelism of heterogeneous architectures compared to the previous GPU implementation. The new version is able to achieve higher GPU occupancy via the new concept of crowds of Monte Carlo walkers, and by enabling more host CPU threads to effectively offload to the GPU. The higher performance is expected to be achieved independent of the underlying hardware, significantly improving developer productivity and reducing code maintenance costs. Scientific productivity is also improved with full support for fallback to CPU execution when GPU implementations are not available or CPU execution is more optimal.


title: Ensemble Reinforcement Learning in Continuous Spaces -- A Hierarchical Multi-Step Approach for Policy Training

abstract: Actor-critic deep reinforcement learning (DRL) algorithms have recently achieved prominent success in tackling various challenging reinforcement learning (RL) problems, particularly complex control tasks with high-dimensional continuous state and action spaces. Nevertheless, existing research showed that actor-critic DRL algorithms often failed to explore their learning environments effectively, resulting in limited learning stability and performance. To address this limitation, several ensemble DRL algorithms have been proposed lately to boost exploration and stabilize the learning process. However, most of existing ensemble algorithms do not explicitly train all base learners towards jointly optimizing the performance of the ensemble. In this paper, we propose a new technique to train an ensemble of base learners based on an innovative multi-step integration method. This training technique enables us to develop a new hierarchical learning algorithm for ensemble DRL that effectively promotes inter-learner collaboration through stable inter-learner parameter sharing. The design of our new algorithm is verified theoretically. The algorithm is also shown empirically to outperform several state-of-the-art DRL algorithms on multiple benchmark RL problems.


title: Reconstruction of event kinematics in semi-inclusive deep-inelastic scattering using the hadronic final state and Machine Learning

abstract: Semi-inclusive deep-inelastic scattering (SIDIS) at the Electron-Ion Collider will allow for precise mapping of the 3D momentum and spin structure of nucleons and nuclei over a large kinematic region. In this contribution, we demonstrate methods utilizing the hadronic final state and scattered electron, as well as machine learning, to more reliably reconstruct the virtual photon four momentum and SIDIS kinematics across the inclusive DIS coverage at the EIC.


title: Data-driven policy iteration algorithm for continuous-time stochastic linear-quadratic optimal control problems

abstract: This paper studies a continuous-time stochastic linear-quadratic (SLQ) optimal control problem on infinite-horizon. A data-driven policy iteration algorithm is proposed to solve the SLQ problem. Without knowing three system coefficient matrices, this algorithm uses the collected data to iteratively approximate a solution of the corresponding stochastic algebraic Riccati equation (SARE). A simulation example is provided to illustrate the effectiveness and applicability of the algorithm.


title: Re-Imagen: Retrieval-Augmented Text-to-Image Generator

abstract: Research on text-to-image generation has witnessed significant progress in generating diverse and photo-realistic images, driven by diffusion and auto-regressive models trained on large-scale image-text data. Though state-of-the-art models can generate high-quality images of common entities, they often have difficulty generating images of uncommon entities, such as `Chortai (dog)' or `Picarones (food)'. To tackle this issue, we present the Retrieval-Augmented Text-to-Image Generator (Re-Imagen), a generative model that uses retrieved information to produce high-fidelity and faithful images, even for rare or unseen entities. Given a text prompt, Re-Imagen accesses an external multi-modal knowledge base to retrieve relevant (image, text) pairs and uses them as references to generate the image. With this retrieval step, Re-Imagen is augmented with the knowledge of high-level semantics and low-level visual details of the mentioned entities, and thus improves its accuracy in generating the entities' visual appearances. We train Re-Imagen on a constructed dataset containing (image, text, retrieval) triples to teach the model to ground on both text prompt and retrieval. Furthermore, we develop a new sampling strategy to interleave the classifier-free guidance for text and retrieval conditions to balance the text and retrieval alignment. Re-Imagen achieves significant gain on FID score over COCO and WikiImage. To further evaluate the capabilities of the model, we introduce EntityDrawBench, a new benchmark that evaluates image generation for diverse entities, from frequent to rare, across multiple object categories including dogs, foods, landmarks, birds, and characters. Human evaluation on EntityDrawBench shows that Re-Imagen can significantly improve the fidelity of generated images, especially on less frequent entities.


title: MAXI J1820+070 X-ray spectral-timing reveals the nature of the accretion flow in black hole binaries

abstract: Black hole X-ray binaries display significant stochastic variability on short time-scales (0.01-100 seconds), with a complex pattern of lags in correlated variability seen in different energy bands. This behaviour is generally interpreted in a model where slow fluctuations stirred up at large radii propagate down through the accretion flow, modulating faster fluctuations generated at smaller radii. Coupling this scenario with radially-stratified emission opens the way to measure the propagation time-scale from data, allowing direct tests of the accretion flow structure. We previously developed a model based on this picture and showed that it could fit NICER (0.5-10 keV) data from the brightest recent black hole transient, MAXI J1820+070. However, here we show it fails when extrapolated to higher energy variability data from Insight-HXMT. We extend our model so that the spectrum emitted at each radius changes shape in response to fluctuations (pivoting) rather than just changing normalisation. This gives the strong suppression of fractional variability as a function of energy seen in the data. The derived propagation time-scale is slower than predicted by a magnetically arrested disc (MAD), despite this system showing a strong jet. Our new model jointly fits the spectrum and variability up to 50 keV, though still cannot match all the data above this. Nonetheless, the good fit for 3-40 keV means the QPO can most easily be explained as an extrinsic modulation of the flow, such as produced in Lense-Thirring precession, rather than arising in an additional spectral-timing component such as the jet.


title: Study of transversity GPDs from pseudoscalar mesons production at EIC of China

abstract: The exclusive $\eta$ and $\pi^0$ electroproduction is studied in the handbag approach based on Generalized Parton Distributions (GPDs) factorization. Predictions of $\pi^0$ and $\eta$ mesons are calculated for future Electron-Ion Collider of China (EicC) energy range using obtained cross sections we extract information on the transversity GPDs contributions to these processes.


title: Multi-stage Information Retrieval for Vietnamese Legal Texts

abstract: This study deals with the problem of information retrieval (IR) for Vietnamese legal texts. Despite being well researched in many languages, information retrieval has still not received much attention from the Vietnamese research community. This is especially true for the case of legal documents, which are hard to process. This study proposes a new approach for information retrieval for Vietnamese legal documents using sentence-transformer. Besides, various experiments are conducted to make comparisons between different transformer models, ranking scores, syllable-level, and word-level training. The experiment results show that the proposed model outperforms models used in current research on information retrieval for Vietnamese documents.


title: Statistical analysis of the Si I 6560.58 \r{A} line observed by CHASE

abstract: The Si I 6560.58 \r{A} line in the H$\alpha$ blue wing is blended with a telluric absorption line from water vapor in ground-based observations. Recent observations with the space-based telescope CHASE provide a new window to study this line. We aim to study the Si I line statistically and to explore possible diagnostics. We select three scannings in the CHASE observations, and measure the equivalent width (EW) and the full width at half maximum (FWHM) for each pixel on the solar disk. We then calculate the theoretical EW and FWHM from the VALC model. An active region is also studied in particular for difference in the quiet Sun and the sunspots. The Si I line is formed at the bottom of the photosphere. The EW of this line increases from the disk center to $\mu$ = 0.2, and then decreases toward the solar limb, while the FWHM shows a monotonically increasing trend. Theoretically predicted EW agrees well with observations, while the predicted FWHM is far smaller due to the absence of unresolved turbulence in models. The macroturbulent velocity is estimated to be 2.80 km s$^{-1}$ at the disk center, and increases to 3.52 km s$^{-1}$ at $\mu$ = 0.2. We do not find any response to flare heating in current observations. Doppler shifts and line widths of the Si I 6560.58 \r{A} and Fe I 6569.21 \r{A} lines can be used to study the mass flows and turbulence of the different photospheric layers. The Si I line has good potentials to diagnose the dynamics and energy transport in the photosphere.


title: Semiorthogonal decompositions for bounded derived categories of gentle algebras

abstract: We study semiorthogonal decompositions of bounded derived categories of gentle algebras and how they are manifested in the geometric model of these categories as constructed by Opper, Plamondon and Schroll. We prove that there is a one-to-one correspondence between such semiorthogonal decompositions and suitable cuts of the marked surface underlying the geometric model. Our main tool is the characterization of basis morphisms between indecomposable objects due to Arnesen, Laking and Pauksztello.


title: The effect of particle anisotropy on the modulation of turbulent flows

abstract: We investigate the modulation of turbulence caused by the presence of finite-size dispersed particles. Bluff (isotropic) spheres vs slender (anisotropic) fibers are considered to understand the influence of the object shape on altering the carrier flow. While at a fixed mass fraction - but different Stokes number - both objects provide a similar bulk effect characterized by a large-scale energy depletion, a scale-by-scale analysis of the energy transfer reveals that the alteration of the whole spectrum is intrinsically different. For bluff objects, the classical energy cascade is shrinked in its extension but unaltered in the energy content and its typical features, while for slender ones we find an alternative energy flux which is essentially mediated by the fluid-solid coupling.


title: Teaching Where to Look: Attention Similarity Knowledge Distillation for Low Resolution Face Recognition

abstract: Deep learning has achieved outstanding performance for face recognition benchmarks, but performance reduces significantly for low resolution (LR) images. We propose an attention similarity knowledge distillation approach, which transfers attention maps obtained from a high resolution (HR) network as a teacher into an LR network as a student to boost LR recognition performance. Inspired by humans being able to approximate an object's region from an LR image based on prior knowledge obtained from HR images, we designed the knowledge distillation loss using the cosine similarity to make the student network's attention resemble the teacher network's attention. Experiments on various LR face related benchmarks confirmed the proposed method generally improved recognition performances on LR settings, outperforming state-of-the-art results by simply transferring well-constructed attention maps. The code and pretrained models are publicly available in the https://github.com/gist-ailab/teaching-where-to-look.


title: NVRadarNet: Real-Time Radar Obstacle and Free Space Detection for Autonomous Driving

abstract: Detecting obstacles is crucial for safe and efficient autonomous driving. To this end, we present NVRadarNet, a deep neural network (DNN) that detects dynamic obstacles and drivable free space using automotive RADAR sensors. The network utilizes temporally accumulated data from multiple RADAR sensors to detect dynamic obstacles and compute their orientation in a top-down bird's-eye view (BEV). The network also regresses drivable free space to detect unclassified obstacles. Our DNN is the first of its kind to utilize sparse RADAR signals in order to perform obstacle and free space detection in real time from RADAR data only. The network has been successfully used for perception on our autonomous vehicles in real self-driving scenarios. The network runs faster than real time on an embedded GPU and shows good generalization across geographic regions.


title: Bidirectional Language Models Are Also Few-shot Learners

abstract: Large language models such as GPT-3 (Brown et al., 2020) can perform arbitrary tasks without undergoing fine-tuning after being prompted with only a few labeled examples. An arbitrary task can be reformulated as a natural language prompt, and a language model can be asked to generate the completion, indirectly performing the task in a paradigm known as prompt-based learning. To date, emergent prompt-based learning capabilities have mainly been demonstrated for unidirectional language models. However, bidirectional language models pre-trained on denoising objectives such as masked language modeling produce stronger learned representations for transfer learning. This motivates the possibility of prompting bidirectional models, but their pre-training objectives have made them largely incompatible with the existing prompting paradigm. We present SAP (Sequential Autoregressive Prompting), a technique that enables the prompting of bidirectional models. Utilizing the machine translation task as a case study, we prompt the bidirectional mT5 model (Xue et al., 2021) with SAP and demonstrate its few-shot and zero-shot translations outperform the few-shot translations of unidirectional models like GPT-3 and XGLM (Lin et al., 2021), despite mT5's approximately 50% fewer parameters. We further show SAP is effective on question answering and summarization. For the first time, our results demonstrate prompt-based learning is an emergent property of a broader class of language models, rather than only unidirectional models.